summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Validate that serializers generate bytes-like (or None) datavalidate_serialized_bytesDana Powers2018-03-081-2/+3
|
* Use local copies in Fetcher._fetchable_partitions to avoid mutation errors ↵Dana Powers2018-03-071-3/+6
| | | | (#1400)
* Fix error var name in _unpack (#1403)j2gg0s2018-03-051-1/+1
| | | Change-Id: I6527da4b70ebec9e08fa50aca9eba717b8361f19
* Validate max_records in KafkaConsumer.poll (#1398)Dana Powers2018-02-271-0/+2
|
* Fix KafkaConsumer compacted offset handling (#1397)Dana Powers2018-02-262-10/+28
|
* Fix byte size estimation with kafka producer (#1393)Blake Embrey2018-02-241-1/+1
|
* Fixes racing condition when message is sent to broker before topic logs are ↵Andre Araujo2018-02-211-3/+19
| | | | created
* Introduce new fixtures to prepare for migration to pytest.Andre Araujo2018-02-219-157/+460
| | | | | | | This commits adds new pytest fixtures in prepation for the migration of unittest.TestCases to pytest test cases. The handling of temporary dir creation was also changed so that we can use the pytest tmpdir fixture after the migration.
* Check timeout type in KafkaClient constructorAndre Araujo2018-02-211-0/+2
| | | | | | | | | | If a future was passed as the only positional parameter it would be assigned to the "timeout_ms" parameter erroneously. This mistake would not raise any exception but would lead to odd behaviour later, what could make it extremely difficult to troubleshoot. Adding a type check ensures that an exception is raise earlier to notify the user about the problem.
* Update string representation of SimpleClientAndre Araujo2018-02-211-1/+1
|
* Use hardware accelerated CRC32C function if available (#1389)Taras Voinarovskyi2018-02-214-5/+28
| | | | | | * Use hardware accelerated CRC32C function if available * Add doc notice of optional `crc32c` package
* Correctly respect timeouts in consumer poll interface (#1384)Braedon Vickers2018-02-211-1/+1
|
* Fix response schemaAlex Eftimie2018-02-201-1/+2
|
* Add Admin CreatePartitions API callAlex Eftimie2018-02-202-1/+32
|
* Removed pytest-catchlog dependencyAndre Araujo2018-02-121-1/+0
| | | | | | | | | No longer necessary since pytest-catchlog has been merged into pytest's core. This commit addresses the following warning in pytest output: pytest-catchlog plugin has been merged into the core, please remove it from your requirements. Fixes #1379
* Bump version for developmentDana Powers2018-02-101-1/+1
|
* Patch Release 1.4.1 (#1376)1.4.1Dana Powers2018-02-093-1/+21
|
* Fix consumer poll stuck error when no available partition (#1375)Yu Kou2018-02-081-1/+1
|
* Increase some integration test timeouts (#1374)Dana Powers2018-02-085-11/+26
|
* Use raw in case string overriden (#1373)Jeff Widman2018-02-081-2/+2
|
* Fix pending completion IndexError bug caused by multiple threads (#1372)Dana Powers2018-02-081-2/+8
|
* Bump version for development of next releaseDana Powers2018-02-071-1/+1
|
* Release 1.4.01.4.0Dana Powers2018-02-076-7/+189
|
* pylint 1.8.2 (#1369)Dana Powers2018-02-062-2/+2
|
* use absolute imports everywhere (#1362)Kevin Tindall2018-02-0643-144/+144
|
* Add Request/Response structs for kafka broker 1.0.0Dana Powers2018-02-066-36/+167
|
* Avoid consuming duplicate compressed messages from mid-batch (#1367)Dana Powers2018-02-052-2/+51
|
* KAFKA-3949: Avoid race condition when subscription changes during rebalance ↵Dana Powers2018-02-027-109/+128
| | | | (#1364)
* Add kafka 1.0.0 to travis integration testsDana Powers2018-02-011-0/+1
|
* Bump `lz4` in `requirements-dev.txt` (#1359)Jeff Widman2018-01-311-1/+1
|
* Use latest pytest 3.4.0, but drop pytest-sugar due to incompatibility (#1361)Dana Powers2018-01-312-3/+1
|
* Stop pinning lz4Jeff Widman2018-01-261-1/+1
| | | | | Opening a PR to check if tests pass with the new version. If so, we'll want to bump `requirements-dev.txt` as well. Many thanks to @jonathanunderwood for his diligent work here: https://github.com/dpkp/kafka-python/issues/1021#issuecomment-359161985
* Use 0.11.0.2 kafka broker for integration testing (#1357)Dana Powers2018-01-257-4/+192
|
* Fix for Python 3 byte string handling in SASL auth (#1353)Christophe Lecointe2018-01-242-2/+4
|
* Remove assertion with side effect (#1348)Buğra Gedik2018-01-231-2/+2
|
* fix reconnect_backoff_max_ms default config bug in KafkaProducer (#1352)C.YAO2018-01-231-1/+1
|
* Name heartbeat thread with group_id; use backoff when polling (#1345)Dana Powers2018-01-161-1/+1
|
* Minor test cleanups (#1343)Dana Powers2018-01-123-2/+5
|
* Avoid KeyError when filtering fetchable partitions (#1344)Dana Powers2018-01-121-2/+2
| | | | * Avoid KeyError when filtering fetchable partitions
* Honor reconnect_backoff in conn.connect() (#1342)Dana Powers2018-01-112-1/+3
| | | * Honor reconnect_backoff in conn.connect()
* Fix coordinator join_future race condition (#1338)Dana Powers2018-01-112-4/+21
| | | * Fix race condition in coordinator join_future handling
* Read all available socket bytes (#1332)Dana Powers2018-01-104-22/+28
| | | | * Recv all available network bytes before parsing * Add experimental support for configuring socket chunking parameters
* Improve KafkaConsumer cleanup (#1339)Dana Powers2018-01-105-22/+62
|
* Fix typo in _try_authenticate_plain (#1333)everpcpc2017-12-281-1/+1
|
* Add security layer negotiation to the GSSAPI authentication. (#1283)Andre Araujo2017-12-261-22/+43
| | | | | | | | | | | | | | | | | | When trying to establish a connection with Kafka using SASL with the GSSAPI authentication mechanism the connection was hanging an timing out after 60 secons. On the Kafka broker side I noticed that the SaslServerAuthenticator was going from the AUTHENTICATE to the FAILED state. The GSSAPI auth implementation was missing the second handshake defined in RFC 2222, which happens after the security context is established. This handshake is used by the client and server to negotiate the security layer (QoP) to be used for the connection. Kafka currently only support the "auth" QoP, so the implementation in this commit doesn't make it configurable, but this can be extended later. With this change I was able to successfully connect to a Kerberos-enabled Kafka broker using the SASL_PLAINTEXT protocol and the GSSAPI mechanism.
* Raise non-API exceptions (#1316)Jeff Widman2017-12-211-5/+1
| | | | | | | | | | | | | The original intent was to catch API exceptions (errors returned by the broker when trying to produce a message) and delegate them to the messages' futures. This is copied from the Java producer. However, we were accidentally catching all exceptions, thereby hiding exceptions from users unless they explicitly check the result of the future. Much better to raise client-side errors directly in the foreground so the user is immediately aware of them and can decide how to handle. Fix #1274
* KAFKA-3888 Use background thread to process consumer heartbeats (#1266)Dana Powers2017-12-2114-738/+977
|
* Pin pylint and lz4 to avoid breaking tests (#1330)Dana Powers2017-12-212-2/+4
|
* Minor Exception cleanupJeff Widman2017-12-127-10/+10
|
* Use non-deprecated exception handlingJeff Widman2017-12-121-1/+1
| | | Pulls in the fix upstream from https://github.com/mhils/backports.socketpair/pull/1