summaryrefslogtreecommitdiff
path: root/kafka/client.py
Commit message (Collapse)AuthorAgeFilesLines
...
* Rollover KafkaClient correlation ids at 2**31 to keep within int32 protocol ↵Dana Powers2015-03-291-7/+7
| | | | encoding
* KafkaClient.get_partition_ids_for_topic now returns empty list for unknown ↵Dana Powers2015-03-021-1/+1
| | | | topics
* Add comment about no server response case in _send_broker_aware_requestDana Powers2015-03-021-0/+5
|
* Avoid topic_partitions KeyError in KafkaClientDana Powers2015-03-021-1/+1
|
* Accept KafkaClient client_id as string or bytes; encode string client_id as ↵Dana Powers2015-03-011-1/+2
| | | | utf-8 bytes internally
* Always return sorted partition ids in KafkaClient.get_partition_ids_for_topic()Dana Powers2015-02-091-1/+1
|
* Merge pull request #282 from wedaly/sphinx-api-docsDana Powers2015-01-231-24/+24
|\ | | | | Add Sphinx API docs
| * Add Sphinx API docsWill Daly2015-01-151-24/+24
| |
* | Catch ReplicaNotAvailableError in MetadataResponse -- per kafka-devs, this ↵Dana Powers2015-01-141-1/+6
|/ | | | error can and should be ignored
* Use six for py3 support in KafkaConsumerDana Powers2014-12-151-3/+3
| | | | Log connection failures w/ traceback in kafka/client.py
* Merge pull request #223 from dpkp/metadata_refactorDana Powers2014-09-081-63/+156
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Metadata Refactor * add MetadataRequest and MetadataResponse namedtuples * add TopicMetadata namedtuple * add error codes to Topic and Partition Metadata * add KafkaClient.send_metadata_request() method * KafkaProtocol.decode_metadata_response changed to return a MetadataResponse object so that it is consistent with server api: [broker_list, topic_list] * raise server exceptions in load_metadata_for_topics(*topics) unless topics is null (full refresh) * Replace non-standard exceptions (LeaderUnavailable, PartitionUnavailable) with server standard exceptions (LeaderNotAvailableError, UnknownTopicOrPartitionError) Conflicts: kafka/client.py test/test_client.py test/test_producer_integration.py test/test_protocol.py
| * Add test for sending produce request to unknown topic w/o auto-creationDana Powers2014-09-011-2/+2
| |
| * Use standard exceptions in client._get_leader_for_partition()Dana Powers2014-09-011-15/+28
| | | | | | | | | | | | - drop custom PartitionUnavailable exception - raise UnknownTopicOrPartitionError or LeaderNotAvailableError - add tests for exception raises
| * Raise UnknownTopicOrPartitionError immediately in ensure_topic_exists -- ↵Dana Powers2014-09-011-0/+4
| | | | | | | | server is not auto-creating
| * load_metadata_for_topics should raise exceptions on explicit topic argsDana Powers2014-09-011-12/+40
| |
| * Refactor internal metadata dicts in KafkaClientDana Powers2014-09-011-20/+56
| | | | | | | | | | | | | | | | - use helper methods not direct access - add get_partition_ids_for_topic - check for topic and partition errors during load_metadata_for_topics - raise LeaderNotAvailableError when topic is being auto-created or UnknownTopicOrPartitionError if auto-creation off
| * No more custom LeaderUnavailableError exception -- raise LeaderNotAvailableErrorDana Powers2014-09-011-3/+3
| |
| * Rearrange KafkaClient method order to group client metadata methods togetherDana Powers2014-09-011-18/+18
| |
| * Improve metadata protocol handlingDana Powers2014-09-011-9/+21
| | | | | | | | | | | | | | | | | | | | - add MetadataRequest and MetadataResponse namedtuples - add TopicMetadata namedtuple - add error codes to Topic and Partition Metadata - add KafkaClient.send_metadata_request() method - KafkaProtocol.decode_metadata_response changed to return a MetadataResponse object so that it is consistent with server api: [broker_list, topic_list]
* | Fix test errors related to mocksMark Roberts2014-09-031-3/+4
| |
* | Fix more tests, only multiprocessing consumer ones remainingBruno Renié2014-09-031-3/+3
| |
* | client_id in bytesBruno Renié2014-09-031-1/+1
| |
* | Make all unit tests pass on py3.3/3.4Bruno Renié2014-09-031-1/+1
|/
* Add pylint to tox.ini; test both kafka and test; default to error-checking ↵Dana Powers2014-08-251-1/+1
| | | | only; fixup errors; skip kafka/queue.py
* Add KafkaTimeoutError (used by client.ensure_topic_exists) and add a testDana Powers2014-08-141-3/+3
|
* Handle New Topic CreationMark Roberts2014-05-221-9/+19
| | | | | Adds ensure_topic_exists to KafkaClient, redirects test case to use that. Fixes #113 and fixes #150.
* Attempt to fix travis build. Decrease complexity of service.py in favor of ↵Mark Roberts2014-05-061-2/+0
| | | | in memory logging. Address code review concerns
* Make BrokerRequestError a base class, make subclasses for each broker errorMark Roberts2014-04-301-19/+17
|
* Refactor away _get_conn_for_broker. Fix bug in _get_connMark Roberts2014-04-091-13/+6
|
* Merge pull request #134 from wizzat/conn_refactorv0.9.0Dana Powers2014-03-211-3/+3
|\ | | | | conn.py performance improvements, make examples work, add another example
| * Merge branch 'master' into conn_refactorMark Roberts2014-03-181-3/+3
| |\
| * \ Merge branch 'master' into conn_refactorMark Roberts2014-02-261-7/+18
| |\ \ | | | | | | | | | | | | | | | | Conflicts: example.py
| * | | Minor refactor in conn.py, update version in __init__.py, add ErrorStringMark Roberts2014-02-251-3/+3
| | | |
* | | | Merge branch 'master' into developmrtheb2014-03-171-9/+20
|\ \ \ \ | | |_|/ | |/| | | | | | | | | | Conflicts: test/test_unit.py
| * | | If a broker refuses the connection, try the nextstephenarmstrong2014-03-131-3/+3
| | |/ | |/|
| * | Support list (or comma-separated) of hosts (replaces host and port arguments)mrtheb2014-02-091-6/+7
| | |
| * | Merge branch 'master' into multihostsmrtheb2014-01-311-91/+120
| |\ \ | | |/ | | | | | | | | | | | | | | | | | | | | | Conflicts: kafka/client.py kafka/conn.py setup.py test/test_integration.py test/test_unit.py
| * | Allow KafkaClient to take in a list of brokers for bootstrappingMarc Labbe2013-11-141-14/+21
| | |
* | | Changes based on comments by @rdiomar, plus added LeaderUnavailableError for ↵mrtheb2014-02-151-4/+7
| | | | | | | | | | | | clarity
* | | check for broker None in send_broker_aware_request (added test for it)mrtheb2014-01-311-5/+14
| | |
* | | Handle cases for partition with leader=-1 (not defined)Marc Labbe2014-01-311-6/+12
| | |
* | | added mockmrtheb2014-01-181-3/+4
| |/ |/|
* | Merge pull request #107 from rdiomar/fix_default_timeoutsMarc Labbé2014-01-161-2/+6
|\ \ | | | | | | Increase default connection timeout
| * | Change default socket timeout to 120 seconds in both the client and connectionOmar Ghishan2014-01-161-2/+6
| | |
* | | Merge branch 'repr' of https://github.com/mahendra/kafka-python into ↵mrtheb2014-01-141-0/+3
|\ \ \ | |/ / |/| | | | | | | | | | | | | | | | | mahendra-repr Conflicts: kafka/client.py kafka/consumer.py
| * | Add proper string representations for each classMahendra M2013-10-081-1/+4
| |/
* | Throw KafkaUnavailableError when no brokers availableThomas Dimson2014-01-131-2/+2
| |
* | Exception hierarchy, invalidate more md on errorsThomas Dimson2014-01-131-80/+88
| |
* | Change BufferUnderflowError to ConnectionError in conn._read_bytes()Omar Ghishan2014-01-081-3/+2
| | | | | | Both errors are handled the same way when raised and caught, so this makes sense.
* | Fix client error handlingOmar Ghishan2014-01-061-5/+17
| | | | | | | | | | This differentiates between errors that occur when sending the request and receiving the response, and adds BufferUnderflowError handling.