feat!: Use pandas custom data types for BigQuery DATE and TIME columns, remove `date_as_object` argument#972

Merged

tswast merged 87 commits intogoogleapis:v3from

jimfulton:dtypes-v3

Nov 10, 2021

Commits on Sep 14, 2021

feat: add pandas time arrays to hold BigQuery TIME data
Jim Fulton
committed
remove commented/aborted base class and simplify super call in __init__
Jim Fulton
committed
dtypes tests pass with pandas 0.24.2
Jim Fulton
committed
blacken and lint
Jim Fulton
committed
Added DateArray and generalized tests to handle dates and times
Jim Fulton
committed
blacken
Jim Fulton
committed
handle bad values passed to areay construction
Jim Fulton
committed
Add null/None handling
Jim Fulton
committed
Added repeat and copy tests
Jim Fulton
committed
don't use extract_array and make _from_sequence_of_strings and alias of _from_sequence
Jim Fulton
committed
Summary test copying ndarray arg
Jim Fulton
committed
expand construction test to test calling class directly and calling _from_sequence_of_strings
Jim Fulton
committed
blacken
Jim Fulton
committed
test size and shape
Jim Fulton
committed
Enable properties for pandas 1.3 and later
Jim Fulton
committed
Test more pandas versions.
Jim Fulton
committed
Updated import_default with an option to force use of the default
Jim Fulton
committed
simplified version-checking code
Jim Fulton
committed
_from_factorized
Jim Fulton
committed
fix small DRY violation for parametrization by date tand time dtypes
Jim Fulton
committed
isna
Jim Fulton
committed
take
Jim Fulton
committed
_concat_same_type
Jim Fulton
committed
fixed __getitem__ to handle array indexes
Jim Fulton
committed
test __getitem__ w arrau index and dropna
Jim Fulton
committed
fix assignment with array keys and fillna test
Jim Fulton
committed
reminder (for someone :) ) to override some abstract implementations for better speed.
Jim Fulton
committed
unique test
Jim Fulton
committed
test argsort
Jim Fulton
committed
fix version in constraint
Jim Fulton
committed
blacken/lint
Jim Fulton
committed
stop fighting the framework and store as ns
Jim Fulton
committed
blacken/lint
Jim Fulton
committed

Commits on Sep 15, 2021

Implement astype to fix Python 3.7 failure
Jim Fulton
committed
test assigning None
Jim Fulton
committed
test astype self type w copy
Jim Fulton
committed
test a concatenation dtype sanity check
Jim Fulton
committed
Added conversion of date to datetime
Jim Fulton
committed
convert times to time deltas
Jim Fulton
committed
Use new pandas date and time dtypes
Jim Fulton
committed
Get rid of date_as_object argument
Jim Fulton
committed
fixed a comment
Jim Fulton
committed
added *unit* test for dealimng with dates and timestamps that can't fit in datetime64[ns]
Jim Fulton
committed

Commits on Sep 16, 2021

Removed brittle hack that enabled series properties.
Jim Fulton
committed
Add note on possible zero-copy optimization for dates
Jim Fulton
committed
Implemented any, all, min, max and median
Jim Fulton
committed
make pytype happy
Jim Fulton
committed
test (and fix) load from dataframe with date and time columns
Jim Fulton
committed
Make sure insert_rows_from_dataframe works
Jim Fulton
committed
Renamed date and time dtypes to bqdate and bqtime
Jim Fulton
committed

Commits on Sep 17, 2021

make fallback date and time dtype names strings to make pytype happy
Jim Fulton
committed
date and time arrays implement __arrow_array__
Jim Fulton
committed
Document new dtypes
Jim Fulton
committed

Commits on Sep 18, 2021

blacken/lint
Jim Fulton
committed
Make conversion of date columns from arrow pandas outout to pandas zero-copy
Jim Fulton
committed
Added date math support
Jim Fulton
committed
fix end tag
Jim Fulton
committed
fixed snippet ref
Jim Fulton
committed
Support date math with DateOffset scalars
Jim Fulton
committed

Commits on Sep 27, 2021

use db-dtypes
Jim Fulton
committed
Include db-dtypes in sample requirements
Jim Fulton
committed
Updated docs and snippets for db-dtypes
Jim Fulton
committed
gaaaa, missed a bqdate
Jim Fulton
committed

Commits on Oct 8, 2021

Merge branch 'v3' into dtypes-v3
parthea
authored

Commits on Nov 1, 2021

Commits on Nov 2, 2021

Commits on Nov 3, 2021

experiment with direct pyarrow to extension array conversion
tswast
committed

Commits on Nov 5, 2021

Merge branch 'v3' into dtypes-v3
tswast
authored

Commits on Nov 9, 2021