summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
...
* | | | Merge pull request #328 from wkiser/validate_offsetDana Powers2015-03-022-0/+8
|\ \ \ \ | | | | | | | | | | Fixes consumer/kafka and consumer/simple to only yield messages if the m...
| * | | | Fixes consumer/kafka and consumer/simple to only yield messages if the ↵wkiser2015-03-022-0/+8
| |/ / / | | | | | | | | | | | | message's offset is greater than or equal to the consumer offset.
* | | | Merge pull request #296 from ecanzonieri/validate_consumer_offsetDana Powers2015-03-021-3/+54
|\ \ \ \ | |/ / / |/| | | Validate consumer offset in SimpleConsumer
| * | | Retry failed partitions and add integration testsEnrico Canzonieri2015-01-261-0/+2
| | | |
| * | | Merge branch 'master' of github.com:mumrah/kafka-python into ↵Enrico Canzonieri2015-01-2616-342/+381
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | validate_consumer_offset Conflicts: kafka/consumer/simple.py
| * | | | Make SimpleConsumer auto_offset_reset more like KafkaConsumerEnrico Canzonieri2015-01-261-4/+19
| | | | |
| * | | | use a list in send_offset_requestEnrico Canzonieri2015-01-141-3/+4
| | | | |
| * | | | Implement offsets reset when OffsetOutOfRangeErrorEnrico Canzonieri2015-01-141-3/+35
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This slightly changes the SimpleConsumer interface adding the default option use_latest_offsets. The fetch behaviour is also changed since it does not raise OffsetOutOfRangeError anymore. Resetting the offsets automatically is especially useful in MultiprocessConsumer, where an explicit seek call is not possible.
* | | | | Merge pull request #314 from dpkp/keyed_producer_failoverDana Powers2015-02-194-8/+9
|\ \ \ \ \ | |_|_|_|/ |/| | | | Handle keyed producer failover
| * | | | Always use the initial partition list when hashing keys in KeyedProducerDana Powers2015-02-091-1/+1
| | | | |
| * | | | make partitions arg optional in *Partitioner.partition, defaulting to ↵Dana Powers2015-02-093-7/+8
| | | | | | | | | | | | | | | | | | | | self.partitions from init
* | | | | Merge pull request #317 from sontek/update_consumer_docsDana Powers2015-02-101-2/+5
|\ \ \ \ \ | |/ / / / |/| | | | Updated documentation for Consumers to prefer KafkaConsumer instead
| * | | | Updated documentation for Consumers to prefer KafkaConsumer insteadJohn Anderson2015-02-091-2/+5
| | | | |
* | | | | Always return sorted partition ids in KafkaClient.get_partition_ids_for_topic()Dana Powers2015-02-091-1/+1
|/ / / /
* | | | 2014 -> 2015David Arthur2015-02-031-1/+1
| | | |
* | | | Removing queue.pyDavid Arthur2015-02-031-215/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | It's just collecting dust and throwing off the coverage report. I pushed a branch queue-fixup in case someone wants to take a stab at refactoring it.
* | | | Fix python2.6 threading.Event bug in ReentrantTimerDana Powers2015-02-031-1/+5
| | | |
* | | | Merge pull request #306 from sontek/catch_topic_not_bytesMark Roberts2015-02-021-1/+7
|\ \ \ \ | | | | | | | | | | Alert if the topic is not sent as bytes
| * | | | Just encode to bytes if it isn't bytes.John Anderson2015-01-241-2/+4
| | | | |
| * | | | Alert if the topic is not sent as bytesJohn Anderson2015-01-231-0/+4
| | |/ / | |/| |
* | | | fix circle referencezhaopengzp2015-02-021-0/+1
|/ / /
* | | Merge pull request #282 from wedaly/sphinx-api-docsDana Powers2015-01-2314-312/+357
|\ \ \ | |_|/ |/| | Add Sphinx API docs
| * | Add Sphinx API docsWill Daly2015-01-1514-312/+357
| |/
* | Catch ReplicaNotAvailableError in MetadataResponse -- per kafka-devs, this ↵Dana Powers2015-01-141-1/+6
| | | | | | | | error can and should be ignored
* | Merge pull request #289 from alexcb/broker-error-class-refactoringDana Powers2015-01-121-24/+12
|\ \ | | | | | | Use reflection to avoid multiple errno definitions
| * | Use reflection to avoid multiple errno definitionsAlex Couture-Beil2015-01-101-24/+12
| |/
* | Merge pull request #286 from Dinoshauer/expose-KafkaConsumer-in-allDana Powers2015-01-121-1/+1
|\ \ | | | | | | KafkaConsumer should be in __all__.
| * | KafkaConsumer should be in __all__.Kasper Jacobsen2015-01-091-1/+1
| |/
* | Randomize start by default for SimpleProducerAlex Couture-Beil2015-01-091-1/+1
|/ | | | | | | | random_start=False is dangerous. Any client that initializes a SimpleProducer and performs only a single publish batch will always go to partition 0. A common use-case for this is command line utilities, or web-servers which are unable to cache the SimpleProducer instance between calls.
* Added keys to compressed messages (both gzip and snappy).Eric Hewitt2015-01-021-2/+2
|
* Merge pull request #234 from dpkp/high_level_consumerMark Roberts2014-12-166-5/+764
|\ | | | | A simpler kafka consumer
| * Add some jitter to refresh_leader_backoff_ms, per wizzat reviewDana Powers2014-12-151-1/+7
| |
| * Simplify BYTES_CONFIGURATION_KEYS logic, per wizzat reviewDana Powers2014-12-151-2/+1
| |
| * Fixup call to self._client.get_partition_ids_for_topic -- use encoded topic ↵Dana Powers2014-12-151-1/+1
| | | | | | | | bytes
| * Use kafka.util.kafka_bytestring to encode utf-8 when necessaryDana Powers2014-12-152-15/+18
| |
| * OffsetCommit metadata must be bytesDana Powers2014-12-151-1/+1
| |
| * Add private methods _does_auto_commit_ms and _does_auto_commit_messagesDana Powers2014-12-151-7/+22
| |
| * Fix task_done checks when no previous commit exists; add testDana Powers2014-12-151-6/+5
| |
| * Force absolue_imports in kafka/consumer/kafka.pyDana Powers2014-12-151-0/+2
| |
| * Move KafkaConsumer to kafka.consumer.kafka module; make available for import ↵Dana Powers2014-12-153-4/+5
| | | | | | | | from kafka at top-level
| * Use six for py3 support in KafkaConsumerDana Powers2014-12-152-16/+42
| | | | | | | | Log connection failures w/ traceback in kafka/client.py
| * Update docstrings w/ current interface / config defaultsDana Powers2014-12-151-16/+21
| |
| * Raise KafkaConfigurationError during fetch_messages if not topics/partitions ↵Dana Powers2014-12-151-1/+7
| | | | | | | | configured
| * Move auto-commit checks to task_done; add support for ↵Dana Powers2014-12-151-11/+27
| | | | | | | | auto_commit_interval_messages
| * Add private methods to manage internal _msg_iterDana Powers2014-12-151-10/+20
| |
| * Reorder methods, add docstrings to public methds, section comments for ↵Dana Powers2014-12-151-207/+255
| | | | | | | | private methods
| * Use 4-space indentsDana Powers2014-12-151-518/+517
| |
| * Add docstring to get_partition_offsets; use request_time_ms and ↵Dana Powers2014-12-151-7/+25
| | | | | | | | max_num_offsets var names
| * Add docstring to configure()Dana Powers2014-12-151-0/+21
| |
| * raise KafkaConfigurationError in commit() if there is no configured ↵Dana Powers2014-12-151-1/+8
| | | | | | | | 'group_id'; add docstring
View Lorry Controller Status