zcloud.gcp_services module

zcloud.gcp_services.connect_to_redis(host, port, password=None)[source]
Return type:

Redis

zcloud.gcp_services.get_bq_client()[source]
zcloud.gcp_services.get_columna_message(envelope)[source]
zcloud.gcp_services.get_redis_instance_endpoint(*args, **kwargs)[source]
Return type:

tuple[str, int]

zcloud.gcp_services.get_redis_instance_from_gcp_project(project_id, location_id, instance_id)[source]
Return type:

tuple[str, int]

zcloud.gcp_services.get_schema(project_id, schema_id)[source]
zcloud.gcp_services.get_storage_client(*args, **kwargs)[source]
zcloud.gcp_services.get_storage_client_from_gcp_project(project_id)[source]
zcloud.gcp_services.pandas_df_to_csv_bytes(df)[source]
Return type:

BytesIO

zcloud.gcp_services.read_manifest(bucket_name, manifest_path)[source]

Reads a manifest file from a GCS bucket.

Note: This function was migrated from the deprecated beam module.

Parameters:

  • bucket_name (str) – The name of the GCS bucket.

  • manifest_path (str) – The path to the manifest file in the bucket.

Returns:

The parsed manifest as a dictionary.

Return type:

dict