Multi-agent systems have been an effective choice for designing control systems that are flexible and agile. However, few attention has been given to the evaluation of the architectures of such systems. This becomes critical with the emerging requirements in complex domains such as digital network infrastructures. In this paper, we propose an approach for the evaluation of agent-based control architectures and introduce three multi-agent based architectures for the supervisory control of network service operations of the next generation of digital infrastructures. With the proposed approach, we evaluated the architectures and the implemented control systems prototypes under a realistic network infrastructure environment. Our approach has been effective to evaluate the candidate architectures. The results of communication overhead and reaction time, have shown that agent-based hierarchical and heterarchical-ring architectures have outperformed the heterarchical-complete network architecture.