PyPI

Availability:

Airbyte Cloud Airbyte OSS PyAirbyte

Support Level:

community

Connector Version:

0.1.8(Last updated 2 days ago)

CDK Version:

0.80.0

Sync Success Rate:

Usage Rate:

This page guides you through the process of setting up the PyPI source connector.

Setup guide

Get package name from PyPI

This is the name given in pip install package_name box. For example, airbyte-cdk is the package name for airbyte-cdk.

Optianlly, provide a version name. If not provided, the release stream, containing data for particular version, cannot be used. The project stream is as same as release stream but contains data for all versions.

Supported streams and sync modes

• Project
• Release
• Stats

Performance considerations

Due to the heavy caching and CDN use, there is currently no rate limiting of PyPI APIs at the edge.

In addition, PyPI reserves the right to temporarily or permanently prohibit a consumer based on irresponsible activity.

Try not to make a lot of requests (thousands) in a short amount of time (minutes). Generally PyPI can handle it, but it’s preferred to make requests in serial over a longer amount of time if possible.

Reference

Config fields reference

Field

Type

Property name

string

project_name

string

version

Changelog

Expand to review

Version	Date	Pull Request	Subject
0.1.8	2024-07-06	40842	Update dependencies
0.1.7	2024-06-25	40459	Update dependencies
0.1.6	2024-06-22	39952	Update dependencies
0.1.5	2024-06-06	39152	[autopull] Upgrade base image to v1.2.2
0.1.4	2024-05-28	38702	Make connector compatible with the builder
0.1.3	2024-04-19	37237	Upgrade to CDK 0.80.0 and manage dependencies with Poetry.
0.1.2	2024-04-15	37237	Base image migration: remove Dockerfile and use the python-connector-base image
0.1.1	2024-04-12	37237	schema descriptions
0.1.0	2022-10-29	18632	Initial Release