Conversation

lukemanley

Perf improvement in ArrowExtensionArray.isna when array has zero nulls or is all nulls.

ASV added for DataFrame.isna:

       before           after         ratio
     [f9438649]       [3cb3cf47]
     <main>           <perf-arrow-isna>
-      32.1±0.5ms      7.95±0.08ms     0.25  frame_methods.Isna.time_isna('float64[pyarrow]')

SOME BENCHMARKS HAVE CHANGED SIGNIFICANTLY.
PERFORMANCE INCREASED.

@lukemanleylukemanley added PerformanceMemory or execution speed performanceArrowpyarrow functionalitylabels Feb 25, 2023
@phoflphofl added this to the 2.1 milestone Feb 25, 2023
@phoflphofl merged commit e057427 into pandas-dev:main Feb 25, 2023
@phofl

thx @lukemanley

@lukemanleylukemanley deleted the perf-arrow-isna branch March 17, 2023 22:04
Sign up for free to join this conversation on . Already have an account? Sign in to comment

@phofl phofl phofl approved these changes

No one assigned
Arrowpyarrow functionalityPerformanceMemory or execution speed performance
None yet
2.1

Successfully merging this pull request may close these issues.