Skip to content

AutoML Tables: Enable users to pass in Pandas Dataframe when calling import_data() and batch_predict() from AutoML Tables client #9116

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
busunkim96 merged 17 commits into from
Aug 28, 2019
Merged

AutoML Tables: Enable users to pass in Pandas Dataframe when calling import_data() and batch_predict() from AutoML Tables client #9116

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
c4fa1e7
Add GCS client
TrucHLe Aug 26, 2019
384657d
Reuse bucket for uploading dataframe
TrucHLe Aug 26, 2019
e872279
Remove unused google.auth dependency
TrucHLe Aug 26, 2019
a3c9454
Remove unused ctor param in GcsClient
TrucHLe Aug 26, 2019
4a6f39c
Use GcsClient in TablesClient
TrucHLe Aug 27, 2019
1f4d4d9
Add unit tests relating to GcsClient in TablesClient
TrucHLe Aug 27, 2019
cfb9013
Add system test for GcsClient
TrucHLe Aug 27, 2019
886d5d6
Auto lint the files
TrucHLe Aug 27, 2019
4f9b107
Update import statement so that Python 2.7 could link library with tests
TrucHLe Aug 27, 2019
1a6bc2a
Resolving comments on Aug 27, 2019
TrucHLe Aug 27, 2019
3222741
Remove unnecesary params in test
TrucHLe Aug 27, 2019
0487504
Auto lint some files
TrucHLe Aug 27, 2019
0818996
Re-lint Tables unit test
TrucHLe Aug 27, 2019
f6b2a9e
Raise exception in GcsClient if Pandas is not imported
TrucHLe Aug 27, 2019
6c2202e
Verify that google.cloud.storage is imported in GcsClient
TrucHLe Aug 27, 2019
ed5f019
Link dependencies to the tests so that Nox can run successfully
TrucHLe Aug 27, 2019
9190485
Init GcsClient only when Pandas Dataframe is passed + Reformat import…
TrucHLe Aug 28, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add unit tests relating to GcsClient in TablesClient
  • Loading branch information
@TrucHLe
TrucHLe committed Aug 27, 2019
commit 1f4d4d9ae7eb7c6aed667d1e239d0bdc7bf5114f
8 changes: 4 additions & 4 deletions automl/google/cloud/automl_v1beta1/tables/tables_client.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -738,7 +738,7 @@ def import_data(

if pandas_dataframe is not None:
bucket_name = self.gcs_client.ensure_bucket_exists(project=project)
gsc_input_uri = self.gcs_client.upload_pandas_dataframe(bucket_name, pandas_dataframe)
gcs_input_uri = self.gcs_client.upload_pandas_dataframe(bucket_name, pandas_dataframe)
request = {"gcs_source": {"input_uris": [gcs_input_uri]}}
elif gcs_input_uris is not None:
if type(gcs_input_uris) != list:
Expand Down Expand Up @@ -2725,9 +2725,9 @@ def batch_predict(

if pandas_dataframe is not None:
bucket_name = self.gcs_client.ensure_bucket_exists(project=project)
gsc_input_uri = self.gcs_client.upload_pandas_dataframe(bucket_name, pandas_dataframe)
request = {"gcs_source": {"input_uris": [gcs_input_uri]}}
if gcs_input_uris is not None:
gcs_input_uri = self.gcs_client.upload_pandas_dataframe(bucket_name, pandas_dataframe)
input_request = {"gcs_source": {"input_uris": [gcs_input_uri]}}
elif gcs_input_uris is not None:
if type(gcs_input_uris) != list:
gcs_input_uris = [gcs_input_uris]
input_request = {"gcs_source": {"input_uris": gcs_input_uris}}
Expand Down
Loading