summaryrefslogtreecommitdiff
path: root/kafka/consumer
Commit message (Collapse)AuthorAgeFilesLines
...
* Remove some unused bits from kafka.consumer.groupDana Powers2015-12-311-5/+0
|
* Improve request pipelining in consumer iteratorDana Powers2015-12-312-13/+28
|
* Support message decompressionDana Powers2015-12-311-19/+15
|
* Support simple message iteration in Fetcher and new KafkaConsumerDana Powers2015-12-302-0/+71
|
* Prefer assert or more-specific error to IllegalState / IllegalArgumentDana Powers2015-12-303-25/+14
|
* More Docstring ImprovementsDana Powers2015-12-303-62/+194
|
* Drop unused KafkaConsumer._ensure_not_closed methodDana Powers2015-12-301-4/+0
|
* Make group_id a Coordinator kwarg (not arg) for consistencyDana Powers2015-12-301-1/+1
|
* Switch configs from attributes to dict to make passing / inspecting easierDana Powers2015-12-292-79/+76
|
* Log as INFO: group join, leader election, partition assignmentsDana Powers2015-12-291-0/+1
|
* Improve various docstringsDana Powers2015-12-291-3/+10
|
* Make add_assigned_partition private(ish) in SubscriptionStateDana Powers2015-12-291-3/+3
|
* Pass auto commit parameters from KafkaConsumer to ConsumerCoordinatorDana Powers2015-12-291-0/+2
|
* Fix broken SubscriptionState.is_assigned callDana Powers2015-12-291-1/+1
|
* kafka.consumer.group.KafkaConsumer: 0.9 coordinator-aware consumerDana Powers2015-12-281-797/+480
| | | | | | | - use ConsumerCoordinator to manage group membership - dynamically assign partitions via group using topic subscription - use upstream configuration parameters as __init__ kwargs - metrics and SSL are still TODO
* Define ConsumerRebalanceListener abstract classDana Powers2015-12-281-0/+84
|
* New class: kafka.consumer.fetcher.FetcherDana Powers2015-12-281-0/+523
| | | | | - manages fetch requests via async client and subscription_state - based on upstream java client
* New class SubscriptionState, based on upstream Java clientDana Powers2015-12-281-0/+304
|
* pylint fixesDana Powers2015-12-103-3/+4
| | | | | | - temporarily ignore kafka/consumer/group.py - temporarily ignore test/test_protocol.py - disable-msg deprecated; use disable= instead
* Drop kafka_bytestringDana Powers2015-12-103-20/+17
|
* Convert OffsetCommit and OffsetFetch protocol encode/decodeDana Powers2015-12-102-6/+6
|
* Handle PartialMessage / ConsumerFetchSizeTooSmall in SimpleConsumerDana Powers2015-12-091-21/+24
|
* Update references to kafka.common Request/Response (now Payload)Dana Powers2015-12-093-23/+18
|
* Fix _mp_consume queue variable name conflictDana Powers2015-12-091-2/+2
|
* Merge branch 'master' into 0.9Zack Dever2015-12-071-0/+4
|\
| * Merge pull request #426 from ucarion/ucarion-kafkaconsumer-closeDana Powers2015-12-061-0/+4
| |\ | | | | | | Add KafkaConsumer#close
| | * Add KafkaConsumer#closeUlysse Carion2015-07-071-0/+4
| | |
* | | Unfinished kafka.consumer.group commitDana Powers2015-12-041-0/+883
|/ /
* | new pylint disables for pylint 1.5.1Zack Dever2015-12-022-2/+2
| | | | | | | | | | tested locally with `pylint --rcfile=pylint.rc -E kafka test`. should pass travis builds.
* | Fix python3 / python2 comments re queue/QueueDana Powers2015-12-022-10/+10
| |
* | Merge pull request #457 from saaros/block-for-number-of-messagesDana Powers2015-12-022-11/+18
|\ \ | | | | | | Consumers get_messages: allow blocking until some messages are received
| * | Consumers get_messages: allow blocking until some messages are receivedOskari Saarenmaa2015-09-182-11/+18
| |/ | | | | | | | | | | | | | | | | Modified MultiProcessConsumer's and SimpleConsumer's `block` argument to allow integer value which defines the number of messages to block for. This allows callers to ask for a high number of messages and block only until some of them are received. Otherwise callers would have to request messages one by one or block for some time.
* | Merge pull request #446 from zackdever/consumer-class-configsDana Powers2015-12-021-2/+3
|\ \ | | | | | | Set default config on consumer class to support subclass config changes.
| * | set default config on consumer class to support subclass config changes.Zack Dever2015-08-131-2/+3
| |/
* | Merge pull request #456 from barricadeio/mp-retryDana Powers2015-12-022-46/+59
|\ \ | | | | | | Support retry semantics in MultiProcessConsumer
| * | Support retry semantics in MultiProcessConsumerRoss Duggan2015-09-142-46/+59
| |/
* | allow to retrieve partition info in mp consumerMartin Olveyra2015-06-293-8/+10
|/
* Merge pull request #412 from haosdent/seek_absolute_offsetDana Powers2015-06-201-17/+46
|\ | | | | fix #410 SimpleConsumer cannot seek to an absolute offset.
| * fix #410 SimpleConsumer cannot seek to an absolute offset.haosdent2015-06-201-17/+46
| |
* | Lower logging level on replica not available and commitEnrico Canzonieri2015-06-191-1/+1
|/
* Refactor SimpleConsumer get_messages and _fetchDana Powers2015-06-101-29/+33
| | | | | - attempt to make these easier to read - add marginal retry logic to internal _fetch loop
* Merge pull request #405 from dpkp/log_error_typeDana Powers2015-06-101-5/+8
|\ | | | | Log response error types in consumer and producer logs
| * Add error type to SimpleConsumer error loggingDana Powers2015-06-101-5/+8
| |
* | Change SimpleConsumer.reset_partition_offset to return offset / None on ↵Dana Powers2015-06-101-5/+19
| | | | | | | | failure (dont raise exception)
* | Change Consumer commit() to return True/False and log error; dont raise ↵Dana Powers2015-06-101-12/+18
|/ | | | client exceptions
* KafkaConsumer style nitsDana Powers2015-06-081-26/+48
|
* Update KafkaConsumer to handle request-specific FailedPayloadsErrorsDana Powers2015-06-081-11/+13
|
* Cleanup imports in kafka/client and kafka/consumerDana Powers2015-06-082-22/+20
|
* Merge pull request #389 from dpkp/task_done_key_errorDana Powers2015-06-081-2/+10
|\ | | | | KafkaConsumer.task_done: warn and skip unrecognized topic-partitions
| * KafkaConsumer.task_done - warn and skip messages from unrecognized ↵Dana Powers2015-06-061-2/+10
| | | | | | | | topic-partitions
View Lorry Controller Status