Distributed Data Collection through Remote Probing in Windows Environments



Distributed Data Collector (DDC) is a framework to ease and automate repetitive executions of console applications (probes) over a set of LAN networked Windows personal computers. The framework allows for the remote execution of probes, providing support for collecting the execution output of probes (standard output and standard error). Additionally, right after a probe execution, the output can be parsed and processed by user defined code (post collecting code) that can act accordingly to user's needs. The framework can be useful to perform repetitive large-scale monitoring and administrative tasks over machines with transient availability, that is, machines that present no guarantees of being available at a given time.
A major strength of DDC lies in the fact that it does not require installation of software in remote nodes, avoiding administrative burdens that remote daemons and alike normally provoke.
Besides presenting the data collection framework, the paper discusses the results of a 30-day monitoring experiment conducted with DDC. The experiment collected resource usage metrics over 169 Windows machines from classroom laboratories of an academic institution.


Windows, Data collecting, Monitoring, Remote execution


PDP'05, February 2005

PDF File

Cited by

Year 2013 : 1 citations

 Tie, Zhixin, ”Mobile-C Based Agent System for Detecting Improper Computer Usage at Computer Laboratories”, Journal of Software, 8(9), pp. 2262-2271, 2013.

Year 2011 : 2 citations

Jesus Omana Iglesias, James Thorburn, Trevor Parsons, John Murphy, and Patrick O’Sullivan, "Scoring System Utilization Through Business Profiles", IEEE CloudCom 2011, 2011.

James Hill and Douglas C. Schmidt Experiences with Service-Oriented Middleware for Dynamic Instrumentation of Enterprise Distributed Real-time and Embedded Systems, Proceedings of the 1st International Symposium on Secure Virtual Infrastructures (DOA-SVI'11), October 17-19, 2011, Crete, Greece.

Year 2009 : 2 citations

C. Fang, Y. Zhao, Z. Wang, “Research and Design of a Service Management System for Deadline Render Farm”, International Conference on Environmental Science and Information Application Technology, Wuhan, China, pp. 542-454, 2009.

Jinwei Wang, Huazhi Sun, Jianping Fan, "DUMS: A Dynamical Updatable Monitoring System for Desktop PCs Used for Distributed Computing", pp 309-310, Third IEEE International Symposium on, Theoretical Aspects of Software Engineering, 2009 (TASE 2009). DOI:10.1109/TASE.2009.44

Year 2005 : 1 citations

Jinwei Wang, Yuzhong Sun, Jianping Fan, "Analysis on Resource Utilization Patterns of Office Computer", Proceedings of the 17th IASTED International Conference Parallel and Distributed Computing and Systems, pp 626-631, 2005.