summaryrefslogtreecommitdiff
path: root/kafka/common.py
Commit message (Collapse)AuthorAgeFilesLines
* Support consumer metadata requeststpalino2015-07-011-0/+22
| | | | | | Support added for ConsumerMetadataRequest and ConsumerMetadataResponse Added consumer-aware request routine for supporting the consumer coordinator Added separate client method for fetching Kafka-committed offsets from the coordinator
* try to fix uncaught FailedPayloadsErrorreAsOn20102015-06-091-0/+2
|
* FailedPayloadsError now only has a single payload; use .payload attributeDana Powers2015-06-061-2/+2
| | | | .failed_payloads attribute has been removed.
* Improve async producer code: logic and style fixesViktor Shlapakov2015-06-031-11/+6
| | | | | | | | | | - send_producer_request with fail_on_error=False to retry failed reqs only - using an internal dict with with namedtuple keys for retry counters - refresh metadata on refresh_error irrespective to retries options - removed infinite retries (retry_options.limit=None) as an over-feature - separate producer init args for retries options (limit,backoff,on_timeouts) - AsyncProducerQueueFull returns a list of failed messages - producer tests improved thanks to @rogaha and @toli
* Fix names for async retries opts, add timeout for putViktor Shlapakov2015-06-031-2/+2
|
* Simplification of retry logicViktor Shlapakov2015-06-031-1/+1
|
* Fix small issues with names/testsViktor Shlapakov2015-06-031-0/+4
|
* Clean and simplify retry logicViktor Shlapakov2015-06-031-0/+17
|
* Improved retry logicViktor Shlapakov2015-06-031-0/+3
|
* Fixed tests and other issues after rebaseViktor Shlapakov2015-06-031-1/+0
|
* Retries for async batchingViktor Shlapakov2015-06-031-2/+10
|
* Fixup indentation in kafka/common.py; add links to protocol definitionsDana Powers2015-03-081-23/+26
|
* Add failed_payloads attribute to FailedPayloadsErrorJob Evers2015-03-081-1/+3
|
* Use reflection to avoid multiple errno definitionsAlex Couture-Beil2015-01-101-24/+12
|
* Use configure() to check and set configuration keysDana Powers2014-12-151-0/+4
|
* A simpler kafka consumer:Dana Powers2014-12-151-0/+7
| | | | | | | | | | | | | | | | | | ``` kafka = KafkaConsumer('topic1') for m in kafka: print m kafka = KafkaConsumer('topic1', 'topic2', group_id='my_consumer_group', auto_commit_enable=True, auto_commit_interval_ms=30 * 1000, auto_offset_reset='smallest') for m in kafka: process_message(m) kafka.task_done(m) ```
* Use standard exceptions in client._get_leader_for_partition()Dana Powers2014-09-011-4/+0
| | | | | | - drop custom PartitionUnavailable exception - raise UnknownTopicOrPartitionError or LeaderNotAvailableError - add tests for exception raises
* No more custom LeaderUnavailableError exception -- raise LeaderNotAvailableErrorDana Powers2014-09-011-4/+0
|
* if error code is not recognized in check_error: raise UnknownErrorDana Powers2014-09-011-2/+6
|
* Improve metadata protocol handlingDana Powers2014-09-011-7/+23
| | | | | | | | | | - add MetadataRequest and MetadataResponse namedtuples - add TopicMetadata namedtuple - add error codes to Topic and Partition Metadata - add KafkaClient.send_metadata_request() method - KafkaProtocol.decode_metadata_response changed to return a MetadataResponse object so that it is consistent with server api: [broker_list, topic_list]
* Add KafkaTimeoutError (used by client.ensure_topic_exists) and add a testDana Powers2014-08-141-0/+4
|
* Improve error handling and tests w.r.t. codecsPatrick Lucas2014-05-071-0/+6
| | | | | | | | | | Add function kafka.protocol.create_message_set() that takes a list of payloads and a codec and returns a message set with the desired encoding. Introduce kafka.common.UnsupportedCodecError, raised if an unknown codec is specified. Include a test for the new function.
* Attempt to fix travis build. Decrease complexity of service.py in favor of ↵Mark Roberts2014-05-061-2/+8
| | | | in memory logging. Address code review concerns
* Make BrokerRequestError a base class, make subclasses for each broker errorMark Roberts2014-04-301-25/+89
|
* Explicit testing of protocol errors. Make tests more explicit, and start ↵Mark Roberts2014-04-081-0/+4
| | | | working on intermittent failures in test_encode_fetch_request and test_encode_produc_request
* Merge pull request #134 from wizzat/conn_refactorv0.9.0Dana Powers2014-03-211-15/+21
|\ | | | | conn.py performance improvements, make examples work, add another example
| * Fix grammar in error stringMark Roberts2014-02-251-1/+1
| |
| * Minor refactor in conn.py, update version in __init__.py, add ErrorStringMark Roberts2014-02-251-15/+21
| |
* | Changes based on comments by @rdiomar, plus added LeaderUnavailableError for ↵mrtheb2014-02-151-0/+4
| | | | | | | | clarity
* | Handle cases for partition with leader=-1 (not defined)Marc Labbe2014-01-311-4/+0
|/
* Throw KafkaUnavailableError when no brokers availableThomas Dimson2014-01-131-0/+4
|
* Exception hierarchy, invalidate more md on errorsThomas Dimson2014-01-131-6/+25
|
* make changes to be more fault tolerant: clean up connections, brokers, ↵Jim Lim2013-10-041-0/+5
| | | | | | | | failed_messages - add integration tests for sync producer - add integration tests for async producer w. leadership election - use log.exception
* style: fix whitespacesVetoshkin Nikita2013-10-031-0/+4
|
* Fix #44 Add missing exception classv0.8.0David Arthur2013-09-241-0/+16
| | | | Also move the exceptions to common instead of util
* PEP8-ify most of the filesMahendra M2013-05-291-11/+34
| | | | consumer.py and conn.py will be done later after pending merges
* Big code re-orgDavid Arthur2013-04-021-0/+43
View Lorry Controller Status