apache/iceberg-python

AI Summary: This issue proposes updating various pre-commit hooks, such as Ruff, Mypy, and Codespell, to their latest versions. It suggests using `pre-commit autoupdate` to identify outdated hooks and emphasizes splitting each hook update into a separate pull request, as some updates may require additional code changes to resolve new linting or typing errors.

AI Summary: The issue describes a bug in the Apache PyIceberg library where schema validation fails to reject invalid Avro identifiers in field names, leading to errors when writing and reading data. The task is to investigate and potentially fix this bug, ensuring that PyIceberg correctly validates schema field names against Avro identifier rules.

AI Summary: The task is to investigate why adding a large number of Parquet files to an Iceberg table using the PyIceberg library is slow. The user's code iteratively adds files in batches, resulting in increasing processing time for each batch. The goal is to identify performance bottlenecks and suggest optimizations, potentially leveraging existing Parquet metadata for faster ingestion.

AI Summary: Improve the PyIceberg documentation for REST catalog connections, specifically clarifying authentication methods (OAuth, credentials, etc.), the `warehouse` parameter, headers like `X-Iceberg-Access-Delegation`, credential vending, remote signing, and providing examples for common REST catalogs such as Glue, Polaris, UC, Lakekeeper, and R2.