With the number of different cloud providers growing the importance for reliable and up-to-date performance data increases to make qualified decision on what providers to use to carry out different tasks. To cope with this issue, this paper proposes a framework usable for distributed and self-organized continuous benchmarking of hybrid and heterogeneous cloud environments. The framework implements a multipurpose job scheduling mechanism spread over a definable set of data centres connected via the open-sourced XMPP protocol. To increase scalability the system's network structure reflects physical geographical sites of the data centres.