Abstract
As information services become increasingly ubiquitous, and are being charged for, users are demanding the ability to choose the quality of an information service based on its cost. In this environment, delivering the right information to the right user at the right time, and with appropriate quality, is the challenge. In addition, resource optimizations must be performed to the degree possible. In this paper we introduce the concept of information quality based system evaluation. The key contribution is a framework in which user/application needs for information quality can be quantified in terms of rigorously defined metrics, existing systems can be evaluated against these metrics, and the tradeoffs between information quality and its cost of provisioning can be examined. Further, this provides an approach to developing information quality aware policies and mechanisms for the system. This framework has been partially validated by applying it to the provisioning of continuous media services, i.e., audio and video, in a distributed environment. This paper presents the case study in detail. Finally, the paper outlines a research program in the area of information quality based system evaluation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Boehm, B. (1978), Characteristics of Software Quality, American Elsevier, New York.
Chee, C.L., C.V. Ramamoorthy and R.A. Paul (1994), “RiskExpert: An Expert STEP Metrics Analyzer,” IEEE COMPSAC, Taiwan.
Grady, R. (1992), Practical Software Metrics for Project Management and Process Improvement, Prentice-Hall, Englewood Cliffs, NJ.
Grady, R. (1994), “Successfully Applying Software Metrics,” IEEE Computer, September.
Lawrence, T.F. (1997), “Metrics for Quality of Service (QoS),” Rome Laboratory working paper.
Mayer-Patel, K. and L. Rowe (1997), “Design and Performance of the Berkeley Continuous Media Toolkit (CMT),” In Proceedings of Multimedia Computing and Networking, pp. 194–206.
Oppenheim, A.N. (1983), Questionnaire Design and Attitude Measurement, Heinemann.
Parikh, S.S. (1997), “StreamGroups: A Mechanism for the Synchronized Delivery of Continuous Media Streams,” M.S. project, Computer Science and Engineering, University of Minnesota, December.
Paul, R.A. (1998), “Metrics Based Software Project Management,” Ph.D. thesis, Computer Science Department, University of Tokyo, Japan.
Part-Enander, E., A. Sjoberg, B. Melin, and P. Isaksson (1996), The Matlab Handbook, Addison-Wesley, Reading, MA.
Porter, A. and R.W. Selby (1990), “Empirically Guided Software Development Using Metric-Based Classification Trees,” IEEE Software, March.
Ramanathan, S. and P.V. Rangan (1993), “Feedback Techniques for ultra-Media Continuity and Inter-Media Synchronization in Distributed Multimedia Systems,” The Computer Journal 36,1, 19–33.
Shinagawa, Y. (1995), “Multiresolution Analysis of Metric Data for Software Engineering,” Internal Technical Report, Purdue University.
Smith, B., L.A. Rowe and S. Yen (1993), “Tcl Distributed Programming,” In Proceedings of the 1993 Tcl/Tk Workshop.
Smith, B. (1996), “Cyclic-UDP: A New Protocol for Continuous Media Communication,” http://www.cs.cornell.edu/Info/Faculty/Brian_Smith.html/Publications.
Sreenan, CJ. (1992), “Synchronization Services for Digital Continuous Media,” Ph.D. thesis, University of Cambridge, UK, October 1992.
Steinmetz, R., N.D. Georganas, and T. Nakagawa (1996), “Guest Editorial: Synchronization Issues in Multimedia Communications,” IEEE Journal on Selected Areas in Communication 14,1 1–4.
Vogel, A., B. Kerherve, G. v. Bochmann, and J. Gecsei (1995), “Distributed Multimedia and QoS: A Survey,” IEEE Multimedia Magazine 3, 10–19.
Weller, E. (1994), “Using Metrics to Manage Software Projects,” IEEE Computer, 27–33.
Wijesekera, D. and J. Srivastava (1996), “Quality of Service Metrics for Continuous Media,” International Journal on Multimedia Tools and Applications 3,1, 127–166.
Wijesekera, D. (1997), “Quality of Service for Continuous Media: Metrics, Validation, Evaluation, and Mechanisms,” Ph.D. dissertation, Computer Science & Engineering, University of Minnesota, December.
Wijesekera, D., S. Varadarajan, S.S. Parikh, and J. Srivastava (1998), “Quality of Service (QoS) Based Evaluation of the Berkeley Continuous Media Toolkit (CMT),” submitted to the ACM/Springer-Verlag Multimedia Systems Journal.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Paul, R.A., Srivastava, J. & Wijesekera, D. Test and evaluation of distributed information system networks. Annals of Software Engineering 8, 289–311 (1999). https://doi.org/10.1023/A:1018979414626
Issue Date:
DOI: https://doi.org/10.1023/A:1018979414626