summaryrefslogtreecommitdiff
path: root/docs/pipeline.rst
blob: e8d257c431e8e959f24855f9fc7a9353506cf491 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
.. _pipeline-chapter:

=========
Pipelines
=========

The ``Pipeline`` class is a subclass of ``StatsClient`` that batches
together several stats before sending. It implements the entire client
interface, plus a ``send()`` method.

``Pipeline`` objects should be created with
``StatsClient().pipeline()``::

    client = StatsClient()

    pipe = client.pipeline()
    pipe.incr('foo')
    pipe.decr('bar')
    pipe.timing('baz', 520)
    pipe.send()

No stats will be sent until ``send()`` is called, at which point they
will be packed into as few UDP packets as possible.


As a Context Manager
====================

``Pipeline`` objects can also be used as context managers::

    with StatsClient().pipeline() as pipe:
        pipe.incr('foo')
        pipe.decr('bar')

``pipe.send()`` will be called automatically when the managed block
exits.


Thread Safety
=============

While ``StatsClient`` instances are considered thread-safe (or at least
as thread-safe as the standard library's ``socket.send`` is),
``Pipeline`` instances **are not thread-safe**. Storing stats for later
creates at least two important race conditions in a multi-threaded
environment. You should create one ``Pipeline`` per-thread, if
necessary.