Skip to content

Jobs: load from storage #1056

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tseaver merged 16 commits into from
Aug 17, 2015
Merged

Jobs: load from storage #1056

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
062d5bb
Match order of CUT methods.
tseaver Aug 11, 2015
14fbb6c
Add 'bigquery.job.LoadFromStorageJob.
tseaver Aug 11, 2015
7b31499
Add 'Client.load_from_storage' factory.
tseaver Aug 11, 2015
0c3232c
Factor out schema resource helpers for re-use.
tseaver Aug 11, 2015
54607e8
Surface 'Table.project'/'Table.dataset_name' properties FBO 'Job'.
tseaver Aug 11, 2015
cd1fdba
Add 'LoadFromStorageJob.begin' API method.
tseaver Aug 11, 2015
66dd746
Add 'LoadFromStorageJob.exists' API method.
tseaver Aug 11, 2015
4da9bb5
Add 'LoadFromStorageJob.reload' API method.
tseaver Aug 11, 2015
15d8663
Accomodate datetime centralization from #1051.
tseaver Aug 12, 2015
e37ab0b
Include 'sourceUris', 'destination' in load configuration.
tseaver Aug 13, 2015
f88dcc3
Add system test for 'load from storage' case.
tseaver Aug 13, 2015
31026aa
Add docstring.
tseaver Aug 13, 2015
31c4b1b
Use a longer var name for temporary file.
tseaver Aug 13, 2015
6549219
Implement 'cancel' API request.
tseaver Aug 14, 2015
9260ae9
Expose quasi-enum types for string values w/ choices.
tseaver Aug 17, 2015
3e10e52
Make load job name / API more explicit:
tseaver Aug 17, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions gcloud/bigquery/client.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@
from gcloud.client import JSONClient
from gcloud.bigquery.connection import Connection
from gcloud.bigquery.dataset import Dataset
from gcloud.bigquery.job import LoadTableFromStorageJob


class Client(JSONClient):
Expand Down Expand Up @@ -96,3 +97,21 @@ def dataset(self, name):
:returns: a new ``Dataset`` instance
"""
return Dataset(name, client=self)

def load_table_from_storage(self, name, destination, *source_uris):
"""Construct a job for loading data into a table from CloudStorage.

:type name: string
:param name: Name of the job.

:type destination: :class:`gcloud.bigquery.table.Table`
:param destination: Table into which data is to be loaded.

:type source_uris: sequence of string
:param source_uris: URIs of data files to be loaded.

:rtype: :class:`gcloud.bigquery.job.LoadTableFromStorageJob`
:returns: a new ``LoadTableFromStorageJob`` instance
"""
return LoadTableFromStorageJob(name, destination, source_uris,
client=self)
Loading