summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * self._topics is private; fixup topic iterations for new TopicAndPartition ↵Dana Powers2014-12-151-44/+67
| | | | | | | | list; add more type checks to set_topic_and_partitions
| * Add set_topic_partitions method to configure topics/partitions to consumeDana Powers2014-12-151-8/+59
| |
| * Use client.get_partition_ids_for_topicDana Powers2014-12-151-4/+4
| |
| * Use configure() to check and set configuration keysDana Powers2014-12-152-59/+71
| |
| * add private methods _set_consumer_timeout_start() and _check_consumer_timeout()Dana Powers2014-12-151-8/+13
| |
| * Handle FailedPayloadsError on client.send_fetch_request; permit offsets(); ↵Dana Powers2014-12-151-16/+35
| | | | | | | | update docstring
| * A simpler kafka consumer:Dana Powers2014-12-152-0/+439
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ``` kafka = KafkaConsumer('topic1') for m in kafka: print m kafka = KafkaConsumer('topic1', 'topic2', group_id='my_consumer_group', auto_commit_enable=True, auto_commit_interval_ms=30 * 1000, auto_offset_reset='smallest') for m in kafka: process_message(m) kafka.task_done(m) ```
* | Merge pull request #277 from pubnub/masterMark Roberts2014-12-161-0/+4
|\ \ | |/ |/| added a send_messages api to KeyedProducer
| * added a send_messages api to KeyedProducerJordan Shaw2014-12-151-0/+4
|/ | | | Signed-off-by: Jordan Shaw <jordan@pubnub.com>
* Merge pull request #276 from jettify/fix-pendingMark Roberts2014-12-152-3/+15
|\ | | | | fix pending method
| * fix pending methodNickolai Novik2014-12-152-3/+15
|/
* Merge pull request #274 from sunisdown/masterDana Powers2014-12-111-3/+4
|\ | | | | update low-level demo in README
| * update low levelsunisdown2014-12-111-3/+4
|/ | | | change KafkaProdocol.encode_message to create_message and change import ProduceRequest from kafka.common
* Merge pull request #268 from se7entyse7en/keyed_messageMark Roberts2014-11-265-27/+47
|\ | | | | Pass key to message sent by `KeyedProducer`
| * Fixed TestKafkaProducerIntegrationLou Marvin Caraig2014-11-262-17/+29
| |
| * Added raise of TypeError for non bytes keyLou Marvin Caraig2014-11-261-1/+6
| |
| * Key is passed when creating messages for both async=False and async=TrueLou Marvin Caraig2014-11-262-6/+7
| |
| * Added private method _send_messages that can accept kwargsLou Marvin Caraig2014-11-261-0/+2
| |
| * Added optional argument key to create_message_set functionLou Marvin Caraig2014-11-261-4/+4
|/
* Make sure to include kafka.partitioner in setup package specDana Powers2014-09-251-0/+1
|
* Merge pull request #243 from wizzat/issue_241Dana Powers2014-09-231-2/+6
|\ | | | | Fixes issue #241, adds kafka.consumer and kafka.producer packages
| * Fixes issue #241, adds kafka.consumer and kafka.producer packagesMark Roberts2014-09-231-2/+6
|/
* Merge pull request #242 from wizzat/pr_225Mark Roberts2014-09-231-1/+1
|\ | | | | Resolve merge conflict in PR #225
| * Resolve merge conflict in PR #225Mark Roberts2014-09-231-1/+1
| |
* | Merge pull request #238 from dpkp/simple_consumer_get_messages_timeoutMark Roberts2014-09-231-4/+5
|\ \ | |/ |/| Fix SimpleConsumer timeout behavior in get_messages (Issue 237)
| * Fix SimpleConsumer timeout behavior in get_messages (Issue 237)Dana Powers2014-09-211-4/+5
|/
* Merge pull request #233 from dpkp/str_join_speedupMark Roberts2014-09-113-71/+91
|\ | | | | Improve string concatenation performance on pypy and python 3
| * Use b''.join([]) instead of += to speedup codeDana Powers2014-09-103-71/+91
| |
* | Merge pull request #232 from dpkp/directory_layoutDana Powers2014-09-1017-873/+950
|\ \ | |/ |/| Separate Consumer/Producer/Partitioner modules
| * Separate consumers/producers/partitionersDana Powers2014-09-1017-873/+950
| |
* | Fixup test_context.py unittest importDana Powers2014-09-101-2/+2
| |
* | Merge pull request #217 from locationlabs/transactionDana Powers2014-09-102-0/+287
|\ \ | | | | | | Commit/rollback consumer offsets via context manager
| * | Rename KafkaTransaction to OffsetCommitContext for clarity.Jesse Myers2014-09-032-36/+36
| | |
| * | Improve documentation in exampleJesse Myers2014-08-301-1/+2
| | |
| * | Add transaction context manager.Jesse Myers2014-08-302-0/+286
| | |
* | | Update python version support in READMEDana Powers2014-09-101-4/+5
| |/ |/|
* | Add recent PR merges to Changelog for 0.9.3Dana Powers2014-09-091-0/+8
| |
* | Bump version to 0.9.3-devDana Powers2014-09-091-1/+1
| |
* | Merge pull request #223 from dpkp/metadata_refactorDana Powers2014-09-088-237/+479
|\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Metadata Refactor * add MetadataRequest and MetadataResponse namedtuples * add TopicMetadata namedtuple * add error codes to Topic and Partition Metadata * add KafkaClient.send_metadata_request() method * KafkaProtocol.decode_metadata_response changed to return a MetadataResponse object so that it is consistent with server api: [broker_list, topic_list] * raise server exceptions in load_metadata_for_topics(*topics) unless topics is null (full refresh) * Replace non-standard exceptions (LeaderUnavailable, PartitionUnavailable) with server standard exceptions (LeaderNotAvailableError, UnknownTopicOrPartitionError) Conflicts: kafka/client.py test/test_client.py test/test_producer_integration.py test/test_protocol.py
| * | Add client unit tests for has_metadata_for_topic and ensure_topic_existsDana Powers2014-09-011-1/+63
| | |
| * | Add test for sending produce request to unknown topic w/o auto-creationDana Powers2014-09-012-2/+27
| | |
| * | Use standard exceptions in client._get_leader_for_partition()Dana Powers2014-09-015-37/+48
| | | | | | | | | | | | | | | | | | - drop custom PartitionUnavailable exception - raise UnknownTopicOrPartitionError or LeaderNotAvailableError - add tests for exception raises
| * | Raise UnknownTopicOrPartitionError immediately in ensure_topic_exists -- ↵Dana Powers2014-09-011-0/+4
| | | | | | | | | | | | server is not auto-creating
| * | load_metadata_for_topics should raise exceptions on explicit topic argsDana Powers2014-09-012-37/+86
| | |
| * | Dont need to use callbacks for offset fetch requestsDana Powers2014-09-011-4/+3
| | |
| * | Refactor internal metadata dicts in KafkaClientDana Powers2014-09-014-33/+69
| | | | | | | | | | | | | | | | | | | | | | | | - use helper methods not direct access - add get_partition_ids_for_topic - check for topic and partition errors during load_metadata_for_topics - raise LeaderNotAvailableError when topic is being auto-created or UnknownTopicOrPartitionError if auto-creation off
| * | No more custom LeaderUnavailableError exception -- raise LeaderNotAvailableErrorDana Powers2014-09-014-11/+6
| | |
| * | if error code is not recognized in check_error: raise UnknownErrorDana Powers2014-09-011-2/+6
| | |
| * | Rearrange KafkaClient method order to group client metadata methods togetherDana Powers2014-09-011-18/+18
| | |
| * | Improve metadata protocol handlingDana Powers2014-09-015-145/+192
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - add MetadataRequest and MetadataResponse namedtuples - add TopicMetadata namedtuple - add error codes to Topic and Partition Metadata - add KafkaClient.send_metadata_request() method - KafkaProtocol.decode_metadata_response changed to return a MetadataResponse object so that it is consistent with server api: [broker_list, topic_list]