Apache Parquet 1.18.0 RC1

What's Changed

• MINOR: Fix error message in SimpleGroup.add() for Binary by @takezoe in #3385
• [minor] remove comment from pom.xml by @dossett in #3382
• Minor: ci-before_install.sh should show wget errors and retry by @dossett in #3381
• Minor: Upgrade spotless plugin by @dossett in #3380
• [minor] Move on from java8 for three core modules by @dossett in #3379
• MINOR: japicmp checks are failing after Java 11 release by @dossett in #3388
• MINOR: Bump version to 1.18.0-SNAPSHOT by @wgtmac in #3389
• GH-3372: Enhance ColumnSizeCommand to sort by size by @wgtmac in #3371
• GH-3399: Hint IDE the source code generated by thrift by @HuaHuaY in #3400
• GH-3387: bump aircompressor to mitigate CVE-2025-67721 by @olegbonar in #3403
• GH-3383: Modernize mockito by @dossett in #3384
• GH-3404: fix CI TestByteBitPacking512VectorLE.unpackValuesUsingVector randomly oom by @HuaHuaY in #3405
• GH-3401: Remove redundant MAP_KEY_VALUE annotation at middle level of logical type map by @HuaHuaY in #3402
• GH-3406: fix Float16 statistics handling for NaN and zero values by @HuaHuaY in #3407
• GH-3215: Sort the list of org.apache.parquet.format.Encoding created … by @mbrannstrom in #3413
• Bump dependabot limit by @Fokko in #3416
• Bump org.mockito:mockito-core from 5.21.0 to 5.22.0 by @dependabot[bot] in #3436
• Bump org.apache:apache from 33 to 37 by @dependabot[bot] in #3431
• Bump protobuf.version from 4.33.2 to 4.34.0 by @dependabot[bot] in #3441
• Bump com.github.luben:zstd-jni from 1.5.7-3 to 1.5.7-7 by @dependabot[bot] in #3442
• Bump org.apache.maven.plugins:maven-shade-plugin from 3.6.0 to 3.6.2 by @dependabot[bot] in #3430
• Bump org.xerial.snappy:snappy-java from 1.1.10.7 to 1.1.10.8 by @dependabot[bot] in #3426
• Bump org.codehaus.mojo:exec-maven-plugin from 3.5.0 to 3.6.3 by @dependabot[bot] in #3440
• Bump org.apache.parquet:parquet-pig from 1.15.0 to 1.15.2 by @dependabot[bot] in #3420
• Bump commons-logging:commons-logging from 1.3.5 to 1.3.6 by @dependabot[bot] in #3418
• Bump com.google.re2j:re2j from 1.7 to 1.8 by @dependabot[bot] in #3433
• Bump org.apache.commons:commons-lang3 from 3.17.0 to 3.20.0 by @dependabot[bot] in #3429
• GH-3411 Expose row group index via Parquet reader by @uros7251brick in #3412
• Bump org.mockito:mockito-core from 5.22.0 to 5.23.0 by @dependabot[bot] in #3445
• Bump net.openhft:zero-allocation-hashing from 0.27ea0 to 0.27ea1 by @dependabot[bot] in #3419
• Bump org.tukaani:xz from 1.10 to 1.12 by @dependabot[bot] in #3417
• Bump it.unimi.dsi:fastutil from 8.5.15 to 8.5.18 by @dependabot[bot] in #3422
• Bump org.apache.commons:commons-text from 1.13.1 to 1.15.0 by @dependabot[bot] in #3438
• GH-3449: Fix BinaryStats int overflow by @Jiayi-Wang-db in #3448
• Bump protobuf.version from 4.34.0 to 4.34.1 by @dependabot[bot] in #3453
• Bump org.apache.arrow:arrow-vector from 17.0.0 to 19.0.0 by @dependabot[bot] in #3454
• GH-3410: Bump jackson dependencies from 2.19.2 to 2.21.2 by @manuzhang in #3460
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.23.1 to 0.25.4 by @dependabot[bot] in #3437
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.25.4 to 0.25.5 by @dependabot[bot] in #3473
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.25.5 to 0.25.6 by @dependabot[bot] in #3491
• Bump com.google.guava:guava from 33.5.0-jre to 33.6.0-jre by @dependabot[bot] in #3492
• GH-3011: Deny further writes after InternalParquetRecordWriter is aborted by @LuciferYang in #3450
• GH-3461: Avoid unnecessary debug logging overhead in record write hot path by @arouel in #3462
• [GH-3408] Add support for stale PR workflow by @ArnavBalyan in #3409
• Remove Parquet-Pig by @dossett in #3377
• Bump com.google.api.grpc:proto-google-common-protos from 2.59.2 to 2.68.0 by @dependabot[bot] in #3474
• Bump org.apache.maven.plugins:maven-dependency-plugin from 3.8.1 to 3.10.0 by @dependabot[bot] in #3425
• PARQUET-3532: Remove hardcoded versions from pom.xml by @Fokko in #3531
• Bump org.codehaus.mojo:build-helper-maven-plugin from 3.6.0 to 3.6.1 by @dependabot[bot] in #3434
• GH-3457: Validate column index for null_pages/null_counts contradiction by @clee704 in #3458
• GH-3112: Fix reading of proto Uint32Value by @0x26res in #3113
• Bump jackson.version from 2.21.2 to 2.21.3 by @dependabot[bot] in #3538
• Bump commons-io:commons-io from 2.21.0 to 2.22.0 by @dependabot[bot] in #3528
• Bump com.github.luben:zstd-jni from 1.5.7-7 to 1.5.7-8 by @dependabot[bot] in #3541
• GH-3464: Improve DeltaByteArrayWriter.writeBytes to avoid unnecessary allocation and scalar prefix comparison by @arouel in #3465
• GH-3478: Fix LZ4_RAW heap decompression by @yadavay-amzn in #3486
• GH-3497: Fix thread-unsafe singleton in DefaultValuesWriterFactory by @arouel in #3498
• GH-3261: Fix integer overflow in CapacityByteArrayOutputStream by @yadavay-amzn in #3525
• GH-3545: Use parquet-java in SCM block by @RussellSpitzer in #3546
• MINOR: Fix Spotless formatting in TestCompressionCodec by @RussellSpitzer in #3551
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.25.6 to 0.25.7 by @dependabot[bot] in #3554
• Bump com.google.api.grpc:proto-google-common-protos from 2.68.0 to 2.71.0 by @dependabot[bot] in #3553
• GH-3451. Add a JMH benchmark for variants by @steveloughran in #3452
• GH-3414: Add parseJson to VariantBuilder for JSON-to-Variant conversion by @gaurav7261 in #3415
• Bump actions/stale from 9 to 10 by @dependabot[bot] in #3527
• GH-3482: parquet-hadoop tests to work behind a web proxy by @alexeyroytman in #3483
• GH-3471: Fix ByteBuffer handling in VariantUtil and VariantBuilder by @rayokota in #3472
• GH-3484: Eliminate per-page heap allocation for CRC32 checksums when using direct ByteBufferAllocator by @arouel in #3485
• Optimizing Variant read path with lazy caching by @nssalian in #3481
• Bump com.github.luben:zstd-jni from 1.5.7-8 to 1.5.7-9 by @dependabot[bot] in #3581
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.25.7 to 0.26.0 by @dependabot[bot] in #3583
• GH-3573: Fix VariantUtil string decoding to use explicit UTF-8 charset by @mikhail-melnik in #3576
• Bump protobuf.version from 4.34.1 to 4.35.0 by @dependabot[bot] in #3582
• GH-3587: Fix parquet.thrift.string.size.limit validation by @divjotarora in #3588
• GH-3572: Bump thrift to 0.23 by @steveloughran in #3589
• Bump org.apache:apache from 37 to 38 by @dependabot[bot] in #3564
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.26.0 to 0.26.1 by @dependabot[bot] in #3592
• Bump com.fasterxml.jackson.core:jackson-databind from 2.21.3 to 2.21.4 by ...

Apache Parquet Java 1.17.1

What's Changed

• Fix reading of proto Uint32Value by @0x26res in #3113
• Bump jackson dependencies from 2.19.2 to 2.21.2 by @manuzhang in #3460
• Bump jackson.version from 2.21.2 to 2.21.3 by @dependabot[bot] in #3538

Full Changelog: apache-parquet-1.17.0...apache-parquet-1.17.1

Apache Parquet Java 1.17.1 RC0

What's Changed

• Fix reading of proto Uint32Value by @0x26res in #3113
• Bump jackson dependencies from 2.19.2 to 2.21.2 by @manuzhang in #3460
• Bump jackson.version from 2.21.2 to 2.21.3 by @dependabot[bot] in #3538

Full Changelog: apache-parquet-1.17.0...apache-parquet-1.17.1-rc0

Apache Parquet 1.17.0

What's Changed

• Add comparator for UnknownLogicalType by @Fokko in #3292
• Allow reading dictionary encoded boolean by @Fokko in #3370
• Bump com.google.guava:guava from 33.4.0-jre to 33.5.0-jre by @dependabot[bot] in #3366
• Bump commons-io:commons-io from 2.18.0 to 2.21.0 by @dependabot[bot] in #3369
• Bump easymock 5.6.0 to support Java 25 by @pan3793 in #3363
• Bump protobuf.version from 3.25.6 to 4.30.2 by @dependabot[bot] in #3182
• Bump protobuf.version from 4.33.1 to 4.33.2 by @dependabot[bot] in #3373
• Bump to Java 11 by @Fokko in #3314
• GH-2815: Allow bytestreamsplit available via Hadoop Configuration by @ArnavBalyan in #3340
• GH-2836: Support reading pure parquet files with cat by @ArnavBalyan in #3332
• GH-2891: Include actual values in validation error messages and improve logging by @ArnavBalyan in #3319
• GH-2961: Cycle detection in AvroSchemaConverter to prevent infinite recursion by @ArnavBalyan in #3272
• GH-2967: Support unified config options for convert parquet-cli by @ArnavBalyan in #3283
• GH-2972: Fix incomplete avro metadata on INT96 schema converter by @ArnavBalyan in #3311
• GH-3149: Enable ParquetAvroReader to handle decimal types for int32/64 by @ArnavBalyan in #3306
• GH-3175: support protobuf library version 4 by @uwemaurer in #3352
• GH-3213: Add the configuration for ByteStreamSplit encoding by @joeyutong in #3214
• GH-3224: Make ParquetProperties.valuesWriterFactory thread safe by @ArnavBalyan in #3308
• GH-3267: Add comprehensive assertions to TestMemPageStore by @ArnavBalyan in #3268
• GH-3273: Add scoped chunk level statistics to avoid unbounded output by @ArnavBalyan in #3274
• GH-3286: Add support for Parquet-Protobuf in Parquet-cli by @ArnavBalyan in #3287
• GH-3290: Restore Snapshot versions for vector/benchmark modules by @ArnavBalyan in #3288
• GH-3294: Include optional profiles for release process by @ArnavBalyan in #3297
• GH-3298: Support unified file based configurations for CLI by @ArnavBalyan in #3304
• GH-3300: add ParquetWriter and ParquetReader builders constructor without params by @jerolba in #3301
• GH-3310: Clean up JIRA references and move to GH issues by @ArnavBalyan in #3309
• GH-3312: Support uuid read converter for parquet thrift by @ArnavBalyan in #3313
• GH-3315: Variant binary read does not take length into account by @jerolba in #3333
• GH-3316: Fix representation type for VariantBuilder decimal by @ArnavBalyan in #3335
• GH-3317: Fix bytes written by VariantBuilder.appendFloat by @ArnavBalyan in #3334
• GH-3320: Ensure parquet reader does not fail due to incorrect statistics by @ArnavBalyan in #3325
• GH-3321 Exclude package-info.class from shaded fastutil dependency by @jerolba in #3322
• GH-3327: Bug fix incorrect compressed size reported by DataPageV1 by @ArnavBalyan in #3326
• GH-3331: Track Column index page skip statistics during file read by @ArnavBalyan in #3330
• GH-3338: Support encrypted files for Parquet CLI commands by @ArnavBalyan in #3339
• GH-3350: Avoid flushing data to cloud when exception is thrown by @Jiayi-Wang-db in #3351
• GH-3358: Add Configurable Thrift Max Message Size for Parquet Metadata Reading by @cravani in #3359
• MINOR: Bump avro.version from 1.11.4 to 1.11.5 by @gszadovszky in #3348
• MINOR: Bump version to 1.17.0-SNAPSHOT by @ArnavBalyan in #3293
• MINOR: Post release of 1.16.0 by @wgtmac in #3305
• MINOR: Remove unused parquet-thrift dependencies by @dossett in #3323
• MINOR: [parquet-column] remove unused test dependencies by @dossett in #3324
• MINOR: parquet-avro tests should not debug to stderr by @dossett in #3329
• docs: Replace JIRA with GitHub Issues by @Fokko in #3303

New Contributors

• @ArnavBalyan made their first contribution in #3288
• @Jiayi-Wang-db made their first contribution in #3351
• @joeyutong made their first contribution in #3214
• @uwemaurer made their first contribution in #3352

Full Changelog: apache-parquet-1.16.0...apache-parquet-1.17.0

Apache Parquet 1.17.0 RC0

What's Changed

• Bump to Java 11 by @Fokko in #3314
• Add comparator for UnknownLogicalType by @Fokko in #3292
• Allow reading dictionary encoded boolean by @Fokko in #3370
• GH-2815: Allow bytestreamsplit available via Hadoop Configuration by @ArnavBalyan in #3340
• GH-2836: Support reading pure parquet files with cat by @ArnavBalyan in #3332
• GH-2891: Include actual values in validation error messages and improve logging by @ArnavBalyan in #3319
• GH-2961: Cycle detection in AvroSchemaConverter to prevent infinite recursion by @ArnavBalyan in #3272
• GH-2967: Support unified config options for convert parquet-cli by @ArnavBalyan in #3283
• GH-2972: Fix incomplete avro metadata on INT96 schema converter by @ArnavBalyan in #3311
• GH-3149: Enable ParquetAvroReader to handle decimal types for int32/64 by @ArnavBalyan in #3306
• GH-3175: support protobuf library version 4 by @uwemaurer in #3352
• GH-3213: Add the configuration for ByteStreamSplit encoding by @joeyutong in #3214
• GH-3224: Make ParquetProperties.valuesWriterFactory thread safe by @ArnavBalyan in #3308
• GH-3267: Add comprehensive assertions to TestMemPageStore by @ArnavBalyan in #3268
• GH-3273: Add scoped chunk level statistics to avoid unbounded output by @ArnavBalyan in #3274
• GH-3286: Add support for Parquet-Protobuf in Parquet-cli by @ArnavBalyan in #3287
• GH-3290: Restore Snapshot versions for vector/benchmark modules by @ArnavBalyan in #3288
• GH-3294: Include optional profiles for release process by @ArnavBalyan in #3297
• GH-3298: Support unified file based configurations for CLI by @ArnavBalyan in #3304
• GH-3300: add ParquetWriter and ParquetReader builders constructor without params by @jerolba in #3301
• GH-3310: Clean up JIRA references and move to GH issues by @ArnavBalyan in #3309
• GH-3312: Support uuid read converter for parquet thrift by @ArnavBalyan in #3313
• GH-3315: Variant binary read does not take length into account by @jerolba in #3333
• GH-3316: Fix representation type for VariantBuilder decimal by @ArnavBalyan in #3335
• GH-3317: Fix bytes written by VariantBuilder.appendFloat by @ArnavBalyan in #3334
• GH-3320: Ensure parquet reader does not fail due to incorrect statistics by @ArnavBalyan in #3325
• GH-3321 Exclude package-info.class from shaded fastutil dependency by @jerolba in #3322
• GH-3327: Bug fix incorrect compressed size reported by DataPageV1 by @ArnavBalyan in #3326
• GH-3331: Track Column index page skip statistics during file read by @ArnavBalyan in #3330
• GH-3338: Support encrypted files for Parquet CLI commands by @ArnavBalyan in #3339
• GH-3350: Avoid flushing data to cloud when exception is thrown by @Jiayi-Wang-db in #3351
• GH-3358: Add Configurable Thrift Max Message Size for Parquet Metadata Reading by @cravani in #3359
• MINOR: Bump avro.version from 1.11.4 to 1.11.5 by @gszadovszky in #3348
• MINOR: Bump version to 1.17.0-SNAPSHOT by @ArnavBalyan in #3293
• MINOR: Post release of 1.16.0 by @wgtmac in #3305
• MINOR: Remove unused parquet-thrift dependencies by @dossett in #3323
• MINOR: [parquet-column] remove unused test dependencies by @dossett in #3324
• MINOR: parquet-avro tests should not debug to stderr by @dossett in #3329
• docs: Replace JIRA with GitHub Issues by @Fokko in #3303
• Bump com.google.guava:guava from 33.4.0-jre to 33.5.0-jre by @dependabot[bot] in #3366
• Bump commons-io:commons-io from 2.18.0 to 2.21.0 by @dependabot[bot] in #3369
• Bump easymock 5.6.0 to support Java 25 by @pan3793 in #3363
• Bump protobuf.version from 3.25.6 to 4.30.2 by @dependabot[bot] in #3182
• Bump protobuf.version from 4.33.1 to 4.33.2 by @dependabot[bot] in #3373

New Contributors

• @ArnavBalyan made their first contribution in #3288
• @Jiayi-Wang-db made their first contribution in #3351
• @joeyutong made their first contribution in #3214
• @uwemaurer made their first contribution in #3352

Full Changelog: apache-parquet-1.16.0-rc0...apache-parquet-1.17.0-rc0

Apache Parquet Java 1.16.0

What's Changed

• GH-2943: Remove hadoop-2 support by @steveloughran in #3061
• MINOR: Use exec-maven-plugin.version property by @Fokko in #3047
• MINOR: Add shading for JDK22 specific classes by @Fokko in #3081
• MINOR: Revert buildnumber-maven-plugin to 3.2.0 by @Fokko in #3082
• GH-3086: Allow for empty beans by @Fokko in #3087
• GH-3089: Add missing license header to pom.xml by @raulcd in #3090
• GH-3078: Use Hadoop FileSystem.openFile() to open files by @steveloughran in #3079
• MINOR: Bump version to 1.16.0-SNAPSHOT by @wgtmac in #3097
• Bump org.codehaus.mojo:exec-maven-plugin from 3.3.0 to 3.5.0 by @dependabot[bot] in #3092
• Bump commons-logging:commons-logging from 1.3.3 to 1.3.4 by @dependabot[bot] in #3094
• Bump net.openhft:zero-allocation-hashing from 0.26ea0 to 0.27ea0 by @dependabot[bot] in #3093
• Bump com.google.api.grpc:proto-google-common-protos from 2.41.0 to 2.50.0 by @dependabot[bot] in #3109
• Bump jackson.version from 2.18.1 to 2.18.2 by @dependabot[bot] in #3108
• MINOR: Remove scala properties from pom.xml by @Fokko in #3104
• GH-3114: Fix LogicalType conversions for nested records on Avro <= 1.8 by @clairemcginty in #3111
• Bump com.google.truth.extensions:truth-proto-extension from 1.4.3 to 1.4.4 by @dependabot[bot] in #3107
• Bump org.cyclonedx:cyclonedx-maven-plugin from 2.8.0 to 2.9.1 by @dependabot[bot] in #3120
• Bump org.apache.commons:commons-text from 1.12.0 to 1.13.0 by @dependabot[bot] in #3119
• MINOR: Remove Joda as a direct dependency by @Fokko in #3132
• Bump org.easymock:easymock from 5.4.0 to 5.5.0 by @dependabot[bot] in #3131
• GH-3099 add libthrift to parquet-cli shaded jar by @Arnaud-Nauwynck in #3100
• GH-3127: Enabled parquet.hadoop.vectored.io.enabled by default by @dongjoon-hyun in #3128
• GH-3123: Omit level histogram for some max levels by @wgtmac in #3124
• GH-3133: Fix SizeStatistics to handle omitted histogram by @wgtmac in #3134
• GH-3125: Add CLI for SizeStatistics by @wgtmac in #3126
• GH-3115-Fix int96 read issue in complex type by @pratyush-sharma-2025 in #3118
• MINOR: Remove parquet-tools from NOTICE by @Fokko in #3140
• Bump com.google.guava:guava from 33.2.1-jre to 33.4.0-jre by @dependabot[bot] in #3137
• Bump protobuf.version from 3.25.5 to 3.25.6 by @dependabot[bot] in #3138
• MINOR: Improve exception message in InternalFileDecryptor by @zhongyujiang in #3143
• Bump com.google.api.grpc:proto-google-common-protos from 2.50.0 to 2.51.0 by @dependabot[bot] in #3151
• MINOR: Remove release script by @Fokko in #3144
• Deprecate Apache Pig integration by @Fokko in #3153
• Bump com.h2database:h2 from 2.3.230 to 2.3.232 by @dependabot[bot] in #3158
• Bump commons-logging:commons-logging from 1.3.4 to 1.3.5 by @dependabot[bot] in #3159
• Add logical type annotation for UnknownType by @Fokko in #3154
• GH-3156: Enable vectored IO by default. by @ahmarsuhail in #3155
• Bump it.unimi.dsi:fastutil from 8.5.13 to 8.5.15 by @dependabot[bot] in #3162
• GH-3122: Correct V2 page header compression fields for zero-size data pages by @ConeyLiu in #3148
• GH-3163: Reduce memory and time overhead of ParquetRewriterTests by @rahulketch in #3164
• MINOR: Reader fails fast when footer size is larger than INT_MAX by @ConeyLiu in #3136
• GH-3168: Restrict trusted packages in the parquet-avro module by @wgtmac in #3169
• GH-3172: Do not drop blocks with some null values if DictionaryFilter is applied for UserDefinedPredicate which keeps null values by @ebartkus in #3173
• Bump jackson.version from 2.18.2 to 2.18.3 by @dependabot[bot] in #3170
• MINOR: update latest version to 1.15.1 by @wgtmac in #3179
• Bump com.google.api.grpc:proto-google-common-protos from 2.51.0 to 2.54.1 by @dependabot[bot] in #3177
• Bump Parquet Format to 2.11 by @Fokko in #3181
• [MINOR] Enable jitpack.io repo only when brotli is required by @pan3793 in #3180
• Minor: Use logicaltypes constants in ParquetMetadataConverter by @aihuaxu in #3186
• GH-3188: Set the global configured column stats enable flag to default by @huaxiangsun in #3189
• GH-3070: Add Variant logical type annotation to parquet-java by @aihuaxu in #3072
• GH-3116: Implement the decoding of Variant values by @gene-db in #3197
• GH-3198: Allow specifying trusted classes by class name by @gszadovszky in #3199
• PARQUET-2417: Add geometry and geography logical type annotations by @zhangfengcdt in #3200
• MINOR: Fix display of logicalTypeAnnotation for parquet cli by @pan3793 in #3184
• GH-3203: HadoopPositionOutputStream.close() to call FSDataOutputStream.flush() by @steveloughran in #3204
• GH-3201: Implement a Variant builder to create Variant values by @gene-db in #3202
• GH-3207: ParquetFileReader supports detachFileInputStream by @pan3793 in #3208
• GH-3205: Make HadoopPositionOutputStream.close() safe to call even if closed by @dominicso in #3206
• Bump com.github.luben:zstd-jni from 1.5.6-6 to 1.5.7-3 by @dependabot[bot] in #3209
• PARQUET-2417: Add statistics support to geometry logical type by @zhangfengcdt in #2971
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.21.0 to 0.23.1 by @dependabot[bot] in #3218
• GH-3211: Implement Variant parquet reader by @cashmand in #3212
• MINOR: Update BoundingBox for Empty and Antimeridian Handling by @zhangfengcdt in #3222
• Bump com.fasterxml.jackson.core:jackson-databind from 2.18.3 to 2.19.0 by @dependabot[bot] in #3225
• GH-3233: Parquet CLI supports version command by @pan3793 in #3234
• GH-3235: Row count limit for each row group by @pan3793 in #3236
• Bump org.apache.commons:commons-text from 1.13.0 to 1.13.1 by @dependabot[bot] in #3240
• MINOR: replace avro test configuration by @zheguang in #3244
• GH-3223: Implement Variant parquet writer by @cashmand in #3221
• GH-3249: Fix incorrect Bloom filter data when reading from ByteArrayInputStream by using readFully() by @wangyum in #3250
• GH-3239: Improve ByteBufferReadable detection in HadoopStream by @wangyum in #3259
• Bump com.google.api.grpc:proto-google-common-protos from 2.54.1 to 2.59.2 by @dependabot[bot] in #3256
• GH-3263: Add DictionaryPage.decode to allow dictionary reuse in the ColumnReaderBase ctor by @pyckle in #3264
• GH-3253: Apply ServicesResourceTransformer to parquet-jackson by @pan3793 in #3260
• minor: Cleanup some small bits in a test by @Fokko in #3265
• GH-3141: Add constructor to ParquetFileReader to allow passing in parquet footer and expose setRequestedSchema that accepts List<ColumnDescriptor> by @pan3793 in #3262
• Bump actions/setup-java from 4 to 5 by @dependabot[bot] in #3276
• Bump j...

Apache Parquet 1.16.0 RC2

What's Changed

• GH-2943: Remove hadoop-2 support by @steveloughran in #3061
• MINOR: Use exec-maven-plugin.version property by @Fokko in #3047
• MINOR: Add shading for JDK22 specific classes by @Fokko in #3081
• MINOR: Revert buildnumber-maven-plugin to 3.2.0 by @Fokko in #3082
• GH-3086: Allow for empty beans by @Fokko in #3087
• GH-3089: Add missing license header to pom.xml by @raulcd in #3090
• GH-3078: Use Hadoop FileSystem.openFile() to open files by @steveloughran in #3079
• MINOR: Bump version to 1.16.0-SNAPSHOT by @wgtmac in #3097
• Bump org.codehaus.mojo:exec-maven-plugin from 3.3.0 to 3.5.0 by @dependabot[bot] in #3092
• Bump commons-logging:commons-logging from 1.3.3 to 1.3.4 by @dependabot[bot] in #3094
• Bump net.openhft:zero-allocation-hashing from 0.26ea0 to 0.27ea0 by @dependabot[bot] in #3093
• Bump com.google.api.grpc:proto-google-common-protos from 2.41.0 to 2.50.0 by @dependabot[bot] in #3109
• Bump jackson.version from 2.18.1 to 2.18.2 by @dependabot[bot] in #3108
• MINOR: Remove scala properties from pom.xml by @Fokko in #3104
• GH-3114: Fix LogicalType conversions for nested records on Avro <= 1.8 by @clairemcginty in #3111
• Bump com.google.truth.extensions:truth-proto-extension from 1.4.3 to 1.4.4 by @dependabot[bot] in #3107
• Bump org.cyclonedx:cyclonedx-maven-plugin from 2.8.0 to 2.9.1 by @dependabot[bot] in #3120
• Bump org.apache.commons:commons-text from 1.12.0 to 1.13.0 by @dependabot[bot] in #3119
• MINOR: Remove Joda as a direct dependency by @Fokko in #3132
• Bump org.easymock:easymock from 5.4.0 to 5.5.0 by @dependabot[bot] in #3131
• GH-3099 add libthrift to parquet-cli shaded jar by @Arnaud-Nauwynck in #3100
• GH-3127: Enabled parquet.hadoop.vectored.io.enabled by default by @dongjoon-hyun in #3128
• GH-3123: Omit level histogram for some max levels by @wgtmac in #3124
• GH-3133: Fix SizeStatistics to handle omitted histogram by @wgtmac in #3134
• GH-3125: Add CLI for SizeStatistics by @wgtmac in #3126
• GH-3115-Fix int96 read issue in complex type by @pratyush-sharma-2025 in #3118
• MINOR: Remove parquet-tools from NOTICE by @Fokko in #3140
• Bump com.google.guava:guava from 33.2.1-jre to 33.4.0-jre by @dependabot[bot] in #3137
• Bump protobuf.version from 3.25.5 to 3.25.6 by @dependabot[bot] in #3138
• MINOR: Improve exception message in InternalFileDecryptor by @zhongyujiang in #3143
• Bump com.google.api.grpc:proto-google-common-protos from 2.50.0 to 2.51.0 by @dependabot[bot] in #3151
• MINOR: Remove release script by @Fokko in #3144
• Deprecate Apache Pig integration by @Fokko in #3153
• Bump com.h2database:h2 from 2.3.230 to 2.3.232 by @dependabot[bot] in #3158
• Bump commons-logging:commons-logging from 1.3.4 to 1.3.5 by @dependabot[bot] in #3159
• Add logical type annotation for UnknownType by @Fokko in #3154
• GH-3156: Enable vectored IO by default. by @ahmarsuhail in #3155
• Bump it.unimi.dsi:fastutil from 8.5.13 to 8.5.15 by @dependabot[bot] in #3162
• GH-3122: Correct V2 page header compression fields for zero-size data pages by @ConeyLiu in #3148
• GH-3163: Reduce memory and time overhead of ParquetRewriterTests by @rahulketch in #3164
• MINOR: Reader fails fast when footer size is larger than INT_MAX by @ConeyLiu in #3136
• GH-3168: Restrict trusted packages in the parquet-avro module by @wgtmac in #3169
• GH-3172: Do not drop blocks with some null values if DictionaryFilter is applied for UserDefinedPredicate which keeps null values by @ebartkus in #3173
• Bump jackson.version from 2.18.2 to 2.18.3 by @dependabot[bot] in #3170
• MINOR: update latest version to 1.15.1 by @wgtmac in #3179
• Bump com.google.api.grpc:proto-google-common-protos from 2.51.0 to 2.54.1 by @dependabot[bot] in #3177
• Bump Parquet Format to 2.11 by @Fokko in #3181
• [MINOR] Enable jitpack.io repo only when brotli is required by @pan3793 in #3180
• Minor: Use logicaltypes constants in ParquetMetadataConverter by @aihuaxu in #3186
• GH-3188: Set the global configured column stats enable flag to default by @huaxiangsun in #3189
• GH-3070: Add Variant logical type annotation to parquet-java by @aihuaxu in #3072
• GH-3116: Implement the decoding of Variant values by @gene-db in #3197
• GH-3198: Allow specifying trusted classes by class name by @gszadovszky in #3199
• PARQUET-2417: Add geometry and geography logical type annotations by @zhangfengcdt in #3200
• MINOR: Fix display of logicalTypeAnnotation for parquet cli by @pan3793 in #3184
• GH-3203: HadoopPositionOutputStream.close() to call FSDataOutputStream.flush() by @steveloughran in #3204
• GH-3201: Implement a Variant builder to create Variant values by @gene-db in #3202
• GH-3207: ParquetFileReader supports detachFileInputStream by @pan3793 in #3208
• GH-3205: Make HadoopPositionOutputStream.close() safe to call even if closed by @dominicso in #3206
• Bump com.github.luben:zstd-jni from 1.5.6-6 to 1.5.7-3 by @dependabot[bot] in #3209
• PARQUET-2417: Add statistics support to geometry logical type by @zhangfengcdt in #2971
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.21.0 to 0.23.1 by @dependabot[bot] in #3218
• GH-3211: Implement Variant parquet reader by @cashmand in #3212
• MINOR: Update BoundingBox for Empty and Antimeridian Handling by @zhangfengcdt in #3222
• Bump com.fasterxml.jackson.core:jackson-databind from 2.18.3 to 2.19.0 by @dependabot[bot] in #3225
• GH-3233: Parquet CLI supports version command by @pan3793 in #3234
• GH-3235: Row count limit for each row group by @pan3793 in #3236
• Bump org.apache.commons:commons-text from 1.13.0 to 1.13.1 by @dependabot[bot] in #3240
• MINOR: replace avro test configuration by @zheguang in #3244
• GH-3223: Implement Variant parquet writer by @cashmand in #3221
• GH-3249: Fix incorrect Bloom filter data when reading from ByteArrayInputStream by using readFully() by @wangyum in #3250
• GH-3239: Improve ByteBufferReadable detection in HadoopStream by @wangyum in #3259
• Bump com.google.api.grpc:proto-google-common-protos from 2.54.1 to 2.59.2 by @dependabot[bot] in #3256
• GH-3263: Add DictionaryPage.decode to allow dictionary reuse in the ColumnReaderBase ctor by @pyckle in #3264
• GH-3253: Apply ServicesResourceTransformer to parquet-jackson by @pan3793 in #3260
• minor: Cleanup some small bits in a test by @Fokko in #3265
• GH-3141: Add constructor to ParquetFileReader to allow passing in parquet footer and expose setRequestedSchema that accepts List<ColumnDescriptor> by @pan3793 in #3262
• Bump actions/setup-java from 4 to 5 by @dependabot[bot] in #3276
• Bump j...

Apache Parquet 1.16.0 RC1

What's Changed

• GH-2943: Remove hadoop-2 support by @steveloughran in #3061
• MINOR: Use exec-maven-plugin.version property by @Fokko in #3047
• MINOR: Add shading for JDK22 specific classes by @Fokko in #3081
• MINOR: Revert buildnumber-maven-plugin to 3.2.0 by @Fokko in #3082
• GH-3086: Allow for empty beans by @Fokko in #3087
• GH-3089: Add missing license header to pom.xml by @raulcd in #3090
• GH-3078: Use Hadoop FileSystem.openFile() to open files by @steveloughran in #3079
• MINOR: Bump version to 1.16.0-SNAPSHOT by @wgtmac in #3097
• Bump org.codehaus.mojo:exec-maven-plugin from 3.3.0 to 3.5.0 by @dependabot[bot] in #3092
• Bump commons-logging:commons-logging from 1.3.3 to 1.3.4 by @dependabot[bot] in #3094
• Bump net.openhft:zero-allocation-hashing from 0.26ea0 to 0.27ea0 by @dependabot[bot] in #3093
• Bump com.google.api.grpc:proto-google-common-protos from 2.41.0 to 2.50.0 by @dependabot[bot] in #3109
• Bump jackson.version from 2.18.1 to 2.18.2 by @dependabot[bot] in #3108
• MINOR: Remove scala properties from pom.xml by @Fokko in #3104
• GH-3114: Fix LogicalType conversions for nested records on Avro <= 1.8 by @clairemcginty in #3111
• Bump com.google.truth.extensions:truth-proto-extension from 1.4.3 to 1.4.4 by @dependabot[bot] in #3107
• Bump org.cyclonedx:cyclonedx-maven-plugin from 2.8.0 to 2.9.1 by @dependabot[bot] in #3120
• Bump org.apache.commons:commons-text from 1.12.0 to 1.13.0 by @dependabot[bot] in #3119
• MINOR: Remove Joda as a direct dependency by @Fokko in #3132
• Bump org.easymock:easymock from 5.4.0 to 5.5.0 by @dependabot[bot] in #3131
• GH-3099 add libthrift to parquet-cli shaded jar by @Arnaud-Nauwynck in #3100
• GH-3127: Enabled parquet.hadoop.vectored.io.enabled by default by @dongjoon-hyun in #3128
• GH-3123: Omit level histogram for some max levels by @wgtmac in #3124
• GH-3133: Fix SizeStatistics to handle omitted histogram by @wgtmac in #3134
• GH-3125: Add CLI for SizeStatistics by @wgtmac in #3126
• GH-3115-Fix int96 read issue in complex type by @pratyush-sharma-2025 in #3118
• MINOR: Remove parquet-tools from NOTICE by @Fokko in #3140
• Bump com.google.guava:guava from 33.2.1-jre to 33.4.0-jre by @dependabot[bot] in #3137
• Bump protobuf.version from 3.25.5 to 3.25.6 by @dependabot[bot] in #3138
• MINOR: Improve exception message in InternalFileDecryptor by @zhongyujiang in #3143
• Bump com.google.api.grpc:proto-google-common-protos from 2.50.0 to 2.51.0 by @dependabot[bot] in #3151
• MINOR: Remove release script by @Fokko in #3144
• Deprecate Apache Pig integration by @Fokko in #3153
• Bump com.h2database:h2 from 2.3.230 to 2.3.232 by @dependabot[bot] in #3158
• Bump commons-logging:commons-logging from 1.3.4 to 1.3.5 by @dependabot[bot] in #3159
• Add logical type annotation for UnknownType by @Fokko in #3154
• GH-3156: Enable vectored IO by default. by @ahmarsuhail in #3155
• Bump it.unimi.dsi:fastutil from 8.5.13 to 8.5.15 by @dependabot[bot] in #3162
• GH-3122: Correct V2 page header compression fields for zero-size data pages by @ConeyLiu in #3148
• GH-3163: Reduce memory and time overhead of ParquetRewriterTests by @rahulketch in #3164
• MINOR: Reader fails fast when footer size is larger than INT_MAX by @ConeyLiu in #3136
• GH-3168: Restrict trusted packages in the parquet-avro module by @wgtmac in #3169
• GH-3172: Do not drop blocks with some null values if DictionaryFilter is applied for UserDefinedPredicate which keeps null values by @ebartkus in #3173
• Bump jackson.version from 2.18.2 to 2.18.3 by @dependabot[bot] in #3170
• MINOR: update latest version to 1.15.1 by @wgtmac in #3179
• Bump com.google.api.grpc:proto-google-common-protos from 2.51.0 to 2.54.1 by @dependabot[bot] in #3177
• Bump Parquet Format to 2.11 by @Fokko in #3181
• [MINOR] Enable jitpack.io repo only when brotli is required by @pan3793 in #3180
• Minor: Use logicaltypes constants in ParquetMetadataConverter by @aihuaxu in #3186
• GH-3188: Set the global configured column stats enable flag to default by @huaxiangsun in #3189
• GH-3070: Add Variant logical type annotation to parquet-java by @aihuaxu in #3072
• GH-3116: Implement the decoding of Variant values by @gene-db in #3197
• GH-3198: Allow specifying trusted classes by class name by @gszadovszky in #3199
• PARQUET-2417: Add geometry and geography logical type annotations by @zhangfengcdt in #3200
• MINOR: Fix display of logicalTypeAnnotation for parquet cli by @pan3793 in #3184
• GH-3203: HadoopPositionOutputStream.close() to call FSDataOutputStream.flush() by @steveloughran in #3204
• GH-3201: Implement a Variant builder to create Variant values by @gene-db in #3202
• GH-3207: ParquetFileReader supports detachFileInputStream by @pan3793 in #3208
• GH-3205: Make HadoopPositionOutputStream.close() safe to call even if closed by @dominicso in #3206
• Bump com.github.luben:zstd-jni from 1.5.6-6 to 1.5.7-3 by @dependabot[bot] in #3209
• PARQUET-2417: Add statistics support to geometry logical type by @zhangfengcdt in #2971
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.21.0 to 0.23.1 by @dependabot[bot] in #3218
• GH-3211: Implement Variant parquet reader by @cashmand in #3212
• MINOR: Update BoundingBox for Empty and Antimeridian Handling by @zhangfengcdt in #3222
• Bump com.fasterxml.jackson.core:jackson-databind from 2.18.3 to 2.19.0 by @dependabot[bot] in #3225
• GH-3233: Parquet CLI supports version command by @pan3793 in #3234
• GH-3235: Row count limit for each row group by @pan3793 in #3236
• Bump org.apache.commons:commons-text from 1.13.0 to 1.13.1 by @dependabot[bot] in #3240
• MINOR: replace avro test configuration by @zheguang in #3244
• GH-3223: Implement Variant parquet writer by @cashmand in #3221
• GH-3249: Fix incorrect Bloom filter data when reading from ByteArrayInputStream by using readFully() by @wangyum in #3250
• GH-3239: Improve ByteBufferReadable detection in HadoopStream by @wangyum in #3259
• Bump com.google.api.grpc:proto-google-common-protos from 2.54.1 to 2.59.2 by @dependabot[bot] in #3256
• GH-3263: Add DictionaryPage.decode to allow dictionary reuse in the ColumnReaderBase ctor by @pyckle in #3264
• GH-3253: Apply ServicesResourceTransformer to parquet-jackson by @pan3793 in #3260
• minor: Cleanup some small bits in a test by @Fokko in #3265
• GH-3141: Add constructor to ParquetFileReader to allow passing in parquet footer and expose setRequestedSchema that accepts List<ColumnDescriptor> by @pan3793 in #3262
• Bump actions/setup-java from 4 to 5 by @dependabot[bot] in #3276
• Bump j...

Apache Parquet Java 1.16.0 RC0

What's Changed

• GH-2943: Remove hadoop-2 support by @steveloughran in #3061
• MINOR: Use exec-maven-plugin.version property by @Fokko in #3047
• MINOR: Add shading for JDK22 specific classes by @Fokko in #3081
• MINOR: Revert buildnumber-maven-plugin to 3.2.0 by @Fokko in #3082
• GH-3086: Allow for empty beans by @Fokko in #3087
• GH-3089: Add missing license header to pom.xml by @raulcd in #3090
• GH-3078: Use Hadoop FileSystem.openFile() to open files by @steveloughran in #3079
• MINOR: Bump version to 1.16.0-SNAPSHOT by @wgtmac in #3097
• Bump org.codehaus.mojo:exec-maven-plugin from 3.3.0 to 3.5.0 by @dependabot[bot] in #3092
• Bump commons-logging:commons-logging from 1.3.3 to 1.3.4 by @dependabot[bot] in #3094
• Bump net.openhft:zero-allocation-hashing from 0.26ea0 to 0.27ea0 by @dependabot[bot] in #3093
• Bump com.google.api.grpc:proto-google-common-protos from 2.41.0 to 2.50.0 by @dependabot[bot] in #3109
• Bump jackson.version from 2.18.1 to 2.18.2 by @dependabot[bot] in #3108
• MINOR: Remove scala properties from pom.xml by @Fokko in #3104
• GH-3114: Fix LogicalType conversions for nested records on Avro <= 1.8 by @clairemcginty in #3111
• Bump com.google.truth.extensions:truth-proto-extension from 1.4.3 to 1.4.4 by @dependabot[bot] in #3107
• Bump org.cyclonedx:cyclonedx-maven-plugin from 2.8.0 to 2.9.1 by @dependabot[bot] in #3120
• Bump org.apache.commons:commons-text from 1.12.0 to 1.13.0 by @dependabot[bot] in #3119
• MINOR: Remove Joda as a direct dependency by @Fokko in #3132
• Bump org.easymock:easymock from 5.4.0 to 5.5.0 by @dependabot[bot] in #3131
• GH-3099 add libthrift to parquet-cli shaded jar by @Arnaud-Nauwynck in #3100
• GH-3127: Enabled parquet.hadoop.vectored.io.enabled by default by @dongjoon-hyun in #3128
• GH-3123: Omit level histogram for some max levels by @wgtmac in #3124
• GH-3133: Fix SizeStatistics to handle omitted histogram by @wgtmac in #3134
• GH-3125: Add CLI for SizeStatistics by @wgtmac in #3126
• GH-3115-Fix int96 read issue in complex type by @pratyush-sharma-2025 in #3118
• MINOR: Remove parquet-tools from NOTICE by @Fokko in #3140
• Bump com.google.guava:guava from 33.2.1-jre to 33.4.0-jre by @dependabot[bot] in #3137
• Bump protobuf.version from 3.25.5 to 3.25.6 by @dependabot[bot] in #3138
• MINOR: Improve exception message in InternalFileDecryptor by @zhongyujiang in #3143
• Bump com.google.api.grpc:proto-google-common-protos from 2.50.0 to 2.51.0 by @dependabot[bot] in #3151
• MINOR: Remove release script by @Fokko in #3144
• Deprecate Apache Pig integration by @Fokko in #3153
• Bump com.h2database:h2 from 2.3.230 to 2.3.232 by @dependabot[bot] in #3158
• Bump commons-logging:commons-logging from 1.3.4 to 1.3.5 by @dependabot[bot] in #3159
• Add logical type annotation for UnknownType by @Fokko in #3154
• GH-3156: Enable vectored IO by default. by @ahmarsuhail in #3155
• Bump it.unimi.dsi:fastutil from 8.5.13 to 8.5.15 by @dependabot[bot] in #3162
• GH-3122: Correct V2 page header compression fields for zero-size data pages by @ConeyLiu in #3148
• GH-3163: Reduce memory and time overhead of ParquetRewriterTests by @rahulketch in #3164
• MINOR: Reader fails fast when footer size is larger than INT_MAX by @ConeyLiu in #3136
• GH-3168: Restrict trusted packages in the parquet-avro module by @wgtmac in #3169
• GH-3172: Do not drop blocks with some null values if DictionaryFilter is applied for UserDefinedPredicate which keeps null values by @ebartkus in #3173
• Bump jackson.version from 2.18.2 to 2.18.3 by @dependabot[bot] in #3170
• MINOR: update latest version to 1.15.1 by @wgtmac in #3179
• Bump com.google.api.grpc:proto-google-common-protos from 2.51.0 to 2.54.1 by @dependabot[bot] in #3177
• Bump Parquet Format to 2.11 by @Fokko in #3181
• [MINOR] Enable jitpack.io repo only when brotli is required by @pan3793 in #3180
• Minor: Use logicaltypes constants in ParquetMetadataConverter by @aihuaxu in #3186
• GH-3188: Set the global configured column stats enable flag to default by @huaxiangsun in #3189
• GH-3070: Add Variant logical type annotation to parquet-java by @aihuaxu in #3072
• GH-3116: Implement the decoding of Variant values by @gene-db in #3197
• GH-3198: Allow specifying trusted classes by class name by @gszadovszky in #3199
• PARQUET-2417: Add geometry and geography logical type annotations by @zhangfengcdt in #3200
• MINOR: Fix display of logicalTypeAnnotation for parquet cli by @pan3793 in #3184
• GH-3203: HadoopPositionOutputStream.close() to call FSDataOutputStream.flush() by @steveloughran in #3204
• GH-3201: Implement a Variant builder to create Variant values by @gene-db in #3202
• GH-3207: ParquetFileReader supports detachFileInputStream by @pan3793 in #3208
• GH-3205: Make HadoopPositionOutputStream.close() safe to call even if closed by @dominicso in #3206
• Bump com.github.luben:zstd-jni from 1.5.6-6 to 1.5.7-3 by @dependabot[bot] in #3209
• PARQUET-2417: Add statistics support to geometry logical type by @zhangfengcdt in #2971
• Bump com.github.siom79.japicmp:japicmp-maven-plugin from 0.21.0 to 0.23.1 by @dependabot[bot] in #3218
• GH-3211: Implement Variant parquet reader by @cashmand in #3212
• MINOR: Update BoundingBox for Empty and Antimeridian Handling by @zhangfengcdt in #3222
• Bump com.fasterxml.jackson.core:jackson-databind from 2.18.3 to 2.19.0 by @dependabot[bot] in #3225
• GH-3233: Parquet CLI supports version command by @pan3793 in #3234
• GH-3235: Row count limit for each row group by @pan3793 in #3236
• Bump org.apache.commons:commons-text from 1.13.0 to 1.13.1 by @dependabot[bot] in #3240
• MINOR: replace avro test configuration by @zheguang in #3244
• GH-3223: Implement Variant parquet writer by @cashmand in #3221
• GH-3249: Fix incorrect Bloom filter data when reading from ByteArrayInputStream by using readFully() by @wangyum in #3250
• GH-3239: Improve ByteBufferReadable detection in HadoopStream by @wangyum in #3259
• Bump com.google.api.grpc:proto-google-common-protos from 2.54.1 to 2.59.2 by @dependabot[bot] in #3256
• GH-3263: Add DictionaryPage.decode to allow dictionary reuse in the ColumnReaderBase ctor by @pyckle in #3264
• GH-3253: Apply ServicesResourceTransformer to parquet-jackson by @pan3793 in #3260
• minor: Cleanup some small bits in a test by @Fokko in #3265
• GH-3141: Add constructor to ParquetFileReader to allow passing in parquet footer and expose setRequestedSchema that accepts List<ColumnDescriptor> by @pan3793 in #3262
• Bump actions/setup-java from 4 to 5 by @dependabot[bot] in #3276
• Bump j...

Apache Parquet Java 1.15.2

What's Changed

• GH-3198: Allow specifying trusted classes by class name in #3199

Full Changelog: apache-parquet-1.15.1...apache-parquet-1.15.2-rc0