summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Allow disabling thread wakeup in send_request_to_node (#2335)HEADmasterAndrew Zhang2023-03-021-2/+3
|
* Fix the link to the compatibility page (#2295)Kurt McKee2022-03-271-1/+1
| | | The current link leads to HTTP 404.
* Fix producerconfigs documentation link (#2226)MandarJKulkarni2021-08-031-1/+1
|
* Fix typo: veriication -> verification (#2207)Dongwook Chan2021-02-211-1/+1
| | | Co-authored-by: will.k <will.k@kakaocorp.com>
* fix typo in documentation (#2178)Nikolay Vasiliev2021-02-201-2/+2
|
* Core Protocol: Add support for flexible versions (#2151)Tincu Gabriel2020-12-026-17/+347
| | | | | | | - Add support for new request and response headers, supporting flexible versions / tagged fields - Add List / Alter partition reassignments APIs - Add support for varints - Add support for compact collections (byte array, string, array)
* Support configuration of custom kafka client for Admin/Consumer/Producer (#2144)Tincu Gabriel2020-12-023-8/+17
|
* Hotfix: TypeError: object of type 'dict_itemiterator' has no len() (#2167)Krzysztof Grabowski2020-11-191-2/+3
| | | | | | | * Hotfix: TypeError: object of type 'dict_itemiterator' has no len() * Avoid looping over items 2x Co-authored-by: Grabowski <chris@crawlinski.com>
* Add the optional compression libs to extras_require (#2123)Jeff Widman2020-11-151-1/+6
|
* Cleanup install instructions for optional libs (#2139)Jeff Widman2020-11-153-31/+57
| | | | | | | | | | | | This cleans up the install instructions to specify that optional libs should be installed using the `kafka-python[opt]` format. This leverages `setuptools`' `extra_requires` feature to let our users choose to inherit any versions pins we might apply to our optional dependencies. This also re-orders the docs slightly to give more visibility to the `crc32c` install because users are unlikely to realize it exists. It also cleans up the formatting of the compression libraries slightly, as they were getting a little unwieldy.
* Add Kafka 2.6.0 to tests and protocol compatibility matrix (#2162)Lourens Naudé2020-11-1512-8/+261
| | | | * Co-authored-by: Andrew Brown <andrew.brown@shopify.com> * Co-authored-by: Aaron Brady <aaron.brady@shopify.com>
* KafkaConsumer: Exit poll if consumer is closed (#2152)Rauli Ikonen2020-11-151-2/+4
|
* Only try to update sensors fetch lag if the unpacked list contains elements ↵Keith So2020-11-051-2/+3
| | | | | (#2158) Previously, if the `unpacked` list was empty, the call to `unpacked[-1]` would throw an `IndexError: list index out of range`
* Cover sticky assignor's metadata method with tests (#2161)Valeria Chernenko2020-11-052-45/+40
|
* Use six.viewitems instead of six.iteritems to avoid encoding problems (#2154)Valeria Chernenko2020-10-301-1/+1
|
* Bump version for developmentDana Powers2020-09-301-1/+1
|
* Add kafka-2.5 to compatibilityDana Powers2020-09-303-4/+4
|
* Patch Release 2.0.22.0.2Dana Powers2020-09-293-1/+94
|
* KIP-54: Implement sticky partition assignment strategy (#2057)Valeria Chernenko2020-09-299-20/+1781
|
* Bump dev requirements (#2129)Jeff Widman2020-09-171-15/+15
| | | | | | | | Also re-order lexicographically. Note that I did not exhaustively test this... there could be edge cases depending on the python version. But I think we should be okay because `tox.ini` is currently testing using with unpinned versions, so I think we're already running these versions in our test suite.
* Fix crc32c deprecation warning (#2128)Jeff Widman2020-09-172-2/+2
| | | Fix a deprecation warning in the newest version.
* Merge _find_coordinator_id methods (#2127)Jeff Widman2020-09-171-42/+27
| | | | | | | | | | | | | | | | Previously there were two methods: * `_find_coordinator_id()` * `_find_many_coordinator_ids()` But they do basically the same thing internally. And we need the plural two places, but the singular only one place. So merge them, and change the function signature to take a list of `group_ids` and return a dict of `group_id: coordinator_id`s. As a result of this, the `describe_groups()` command should scale better because the `_find_coordinator_ids()` command issues all the requests async, instead of sequentially blocking as the `described_groups()` used to do.
* Lint cleanup (#2126)Jeff Widman2020-09-171-4/+3
| | | Small cleanup leftover from https://github.com/dpkp/kafka-python/pull/2035
* Feature: delete consumergroups (#2040)Swen Wenzel2020-09-174-5/+219
| | | | | * Add consumergroup related errors * Add DeleteGroups to protocol.admin * Implement delete_groups feature on KafkaAdminClient
* Fix initialization order in KafkaClient (#2119)Pedro Calleja2020-09-161-3/+6
| | | Fix initialization order in KafkaClient
* Allow configurable timeouts in admin client check versionHimanshu Mishra2020-09-161-2/+2
| | | Currently there's no way to pass timeout to check_version if called from admin.
* Added crc32c extra requirement as per issue #2068Misha Seltzer2020-09-161-0/+1
|
* Enhancement for Kafka Admin Client's "Describe Consumer Group" (#2035)Apurva0072020-09-163-16/+146
| | | | | | Adding namedtuples for DescribeConsumerGroup response; Adding Serialization of MemberData and MemberAssignment for the response Co-authored-by: Apurva Telang <atelang@paypal.com> Co-authored-by: Jeff Widman <jeff@jeffwidman.com>
* producer/kafka: Disable logging during object destruction (#2043)Gioele2020-09-071-0/+8
|
* Update example.py (#2081)Mostafa-Elmenbawy2020-09-071-18/+28
| | | Co-authored-by: MostafaElmenabawy <momenabawy@synapse-analytics.io>
* Add kafka.structs docstrings (#2080)Mostafa-Elmenbawy2020-09-071-3/+58
| | | Co-authored-by: MostafaElmenabawy <momenabawy@synapse-analytics.io>
* Add support for `zstd` compression (#2021)Tincu Gabriel2020-09-0710-23/+75
|
* fixed the broken compatibility page link (#2045)Anurag Rana2020-09-071-1/+1
|
* Fix typo (#2096)KimDongMin2020-09-071-1/+1
|
* Fix #1985: fix consumer deadlock when heartbeat thread request timeout (#2064)huangcuiyang2020-09-071-8/+12
|
* Python 3.8 support (#2088)Swen Kooij2020-07-225-9/+11
|
* remove unused importsJames Lamb2020-07-104-4/+0
|
* Rename README to README.md (#2055)qhzxc00152020-05-261-0/+0
| | | rename
* Add logic for inferring newer broker versions (#2038)Tincu Gabriel2020-05-0511-10/+315
| | | | | | | | | | | | | | * Add logic for inferring newer broker versions - New Fetch / ListOffsets request / response objects - Add new test cases to inferr code based on mentioned objects - Add unit test to check inferred version against whatever resides in KAFKA_VERSION - Add new kafka broker versions to integration list - Add more kafka broker versions to travis task list - Add support for broker version 2.5 id * Implement PR change requests: fewer versions for travis testing, remove unused older versions for inference code, remove one minor version from known server list Do not use newly created ACL request / responses in allowed version lists, due to flexible versions enabling in kafka actually requiring a serialization protocol header update Revert admin client file change
* Add `log_start_offset` to message protocol parsing (#2020)Tincu Gabriel2020-03-254-15/+107
| | | This is in preparation for adding `zstd` support.
* Add 2.1.1 to build_integration (#2019)Tincu Gabriel2020-03-161-1/+1
|
* Fix docs by adding SASL mentionJeff Widman2020-03-021-1/+2
| | | | | This was previously supported but wasn't documented. Fix #1990.
* Set length of header value to 0 if Nonekvfi2020-03-021-1/+3
|
* Bump version for developmentDana Powers2020-02-191-1/+1
|
* Patch Release 2.0.12.0.1Dana Powers2020-02-193-1/+16
|
* KAFKA-8962: Use least_loaded_node() for describe_topics()Jeff Widman2020-02-161-15/+7
| | | | | | | | | | | | | | | | | | | | | | | In KAFKA-8962 the `AdminClient.describe_topics()` call was changed from using the controller to using the `least_loaded_node()`: https://github.com/apache/kafka/commit/317089663cc7ff4fdfcba6ee434f455e8ae13acd#diff-6869b8fccf6b098cbcb0676e8ceb26a7R1540 As a result, no metadata request/response processing needs to happen through the controller, so it's safe to remove the custom error-checking. Besides, I don't think this error-checking even added any value because AFAIK no metadata response would return a `NotControllerError` because the recipient broker wouldn't realize the metadata request was intended for only the controller. Originally our admin client was implemented using the least-loaded-node, then later updated to the controller. So updating it back to least-loaded node is a simple case of reverting the associated commits. This reverts commit 7195f0369c7dbe25aea2c3fed78d2b4f772d775b. This reverts commit 6e2978edee9a06e9dbe60afcac226b27b83cbc74. This reverts commit f92889af79db08ef26d89cb18bd48c7dd5080010.
* Fix topic error parsing in MetadataResponseJeff Tribble2020-02-151-6/+11
|
* Bump version for development of next releaseDana Powers2020-02-101-1/+1
|
* Release 2.0.02.0.0Dana Powers2020-02-103-1/+100
|
* _send_request_to_controller returns a raw result, not a futureTyler Lubeck2020-02-061-6/+6
|