summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
* Fix python2.6 threading.Event bug in ReentrantTimerDana Powers2015-02-031-1/+5
|
* Merge pull request #306 from sontek/catch_topic_not_bytesMark Roberts2015-02-021-1/+7
|\ | | | | Alert if the topic is not sent as bytes
| * Just encode to bytes if it isn't bytes.John Anderson2015-01-241-2/+4
| |
| * Alert if the topic is not sent as bytesJohn Anderson2015-01-231-0/+4
| |
* | fix circle referencezhaopengzp2015-02-021-0/+1
|/
* Merge pull request #282 from wedaly/sphinx-api-docsDana Powers2015-01-2314-312/+357
|\ | | | | Add Sphinx API docs
| * Add Sphinx API docsWill Daly2015-01-1514-312/+357
| |
* | Catch ReplicaNotAvailableError in MetadataResponse -- per kafka-devs, this ↵Dana Powers2015-01-141-1/+6
| | | | | | | | error can and should be ignored
* | Merge pull request #289 from alexcb/broker-error-class-refactoringDana Powers2015-01-121-24/+12
|\ \ | | | | | | Use reflection to avoid multiple errno definitions
| * | Use reflection to avoid multiple errno definitionsAlex Couture-Beil2015-01-101-24/+12
| |/
* | Merge pull request #286 from Dinoshauer/expose-KafkaConsumer-in-allDana Powers2015-01-121-1/+1
|\ \ | | | | | | KafkaConsumer should be in __all__.
| * | KafkaConsumer should be in __all__.Kasper Jacobsen2015-01-091-1/+1
| |/
* | Randomize start by default for SimpleProducerAlex Couture-Beil2015-01-091-1/+1
|/ | | | | | | | random_start=False is dangerous. Any client that initializes a SimpleProducer and performs only a single publish batch will always go to partition 0. A common use-case for this is command line utilities, or web-servers which are unable to cache the SimpleProducer instance between calls.
* Added keys to compressed messages (both gzip and snappy).Eric Hewitt2015-01-021-2/+2
|
* Merge pull request #234 from dpkp/high_level_consumerMark Roberts2014-12-166-5/+764
|\ | | | | A simpler kafka consumer
| * Add some jitter to refresh_leader_backoff_ms, per wizzat reviewDana Powers2014-12-151-1/+7
| |
| * Simplify BYTES_CONFIGURATION_KEYS logic, per wizzat reviewDana Powers2014-12-151-2/+1
| |
| * Fixup call to self._client.get_partition_ids_for_topic -- use encoded topic ↵Dana Powers2014-12-151-1/+1
| | | | | | | | bytes
| * Use kafka.util.kafka_bytestring to encode utf-8 when necessaryDana Powers2014-12-152-15/+18
| |
| * OffsetCommit metadata must be bytesDana Powers2014-12-151-1/+1
| |
| * Add private methods _does_auto_commit_ms and _does_auto_commit_messagesDana Powers2014-12-151-7/+22
| |
| * Fix task_done checks when no previous commit exists; add testDana Powers2014-12-151-6/+5
| |
| * Force absolue_imports in kafka/consumer/kafka.pyDana Powers2014-12-151-0/+2
| |
| * Move KafkaConsumer to kafka.consumer.kafka module; make available for import ↵Dana Powers2014-12-153-4/+5
| | | | | | | | from kafka at top-level
| * Use six for py3 support in KafkaConsumerDana Powers2014-12-152-16/+42
| | | | | | | | Log connection failures w/ traceback in kafka/client.py
| * Update docstrings w/ current interface / config defaultsDana Powers2014-12-151-16/+21
| |
| * Raise KafkaConfigurationError during fetch_messages if not topics/partitions ↵Dana Powers2014-12-151-1/+7
| | | | | | | | configured
| * Move auto-commit checks to task_done; add support for ↵Dana Powers2014-12-151-11/+27
| | | | | | | | auto_commit_interval_messages
| * Add private methods to manage internal _msg_iterDana Powers2014-12-151-10/+20
| |
| * Reorder methods, add docstrings to public methds, section comments for ↵Dana Powers2014-12-151-207/+255
| | | | | | | | private methods
| * Use 4-space indentsDana Powers2014-12-151-518/+517
| |
| * Add docstring to get_partition_offsets; use request_time_ms and ↵Dana Powers2014-12-151-7/+25
| | | | | | | | max_num_offsets var names
| * Add docstring to configure()Dana Powers2014-12-151-0/+21
| |
| * raise KafkaConfigurationError in commit() if there is no configured ↵Dana Powers2014-12-151-1/+8
| | | | | | | | 'group_id'; add docstring
| * _should_auto_commit is privateDana Powers2014-12-151-2/+2
| |
| * Support setting offsets in set_topic_partitions(); reorganize offsets ↵Dana Powers2014-12-151-127/+151
| | | | | | | | initialization
| * _client is private varDana Powers2014-12-151-7/+11
| |
| * Move kafka._msg_iter initialization from __init__() to next()Dana Powers2014-12-151-6/+7
| |
| * self._topics is private; fixup topic iterations for new TopicAndPartition ↵Dana Powers2014-12-151-44/+67
| | | | | | | | list; add more type checks to set_topic_and_partitions
| * Add set_topic_partitions method to configure topics/partitions to consumeDana Powers2014-12-151-8/+59
| |
| * Use client.get_partition_ids_for_topicDana Powers2014-12-151-4/+4
| |
| * Use configure() to check and set configuration keysDana Powers2014-12-152-59/+71
| |
| * add private methods _set_consumer_timeout_start() and _check_consumer_timeout()Dana Powers2014-12-151-8/+13
| |
| * Handle FailedPayloadsError on client.send_fetch_request; permit offsets(); ↵Dana Powers2014-12-151-16/+35
| | | | | | | | update docstring
| * A simpler kafka consumer:Dana Powers2014-12-152-0/+439
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ``` kafka = KafkaConsumer('topic1') for m in kafka: print m kafka = KafkaConsumer('topic1', 'topic2', group_id='my_consumer_group', auto_commit_enable=True, auto_commit_interval_ms=30 * 1000, auto_offset_reset='smallest') for m in kafka: process_message(m) kafka.task_done(m) ```
* | added a send_messages api to KeyedProducerJordan Shaw2014-12-151-0/+4
|/ | | | Signed-off-by: Jordan Shaw <jordan@pubnub.com>
* fix pending methodNickolai Novik2014-12-151-1/+1
|
* Added raise of TypeError for non bytes keyLou Marvin Caraig2014-11-261-1/+6
|
* Key is passed when creating messages for both async=False and async=TrueLou Marvin Caraig2014-11-262-6/+7
|
* Added private method _send_messages that can accept kwargsLou Marvin Caraig2014-11-261-0/+2
|
View Lorry Controller Status