home *** CD-ROM | disk | FTP | other *** search
- Submitted-by: sethr@cbnewsl.att.com
-
- The problem with the test assertions analyses that I have
- seen is that somehow there is confusion as to what the
- real standard is. In the case of POSIX.1, all implementations
- must conform to the terms of 1003.1-19XX. Any test assertion
- that assumes more than this or something contradictory to
- 1003.1-19XX is broken. The under-lying base standard always
- prevails. The interpretations process notably lies not within
- any test methodology group, but within active and former members of
- the 1003.1 committee who have participated in the development
- of the base standard in question. Any deviation in the Test
- Methodology is routinely resolved in favor of the base standard.
-
- What test methods are useful for, is for Test Implementors
- to be able to eliminate the overhead of having to identify
- independently all the requirements of 1003.1. This also
- presumably makes for more consistent testing vehicles. If the
- Test Methodology is missing things, this is a quality issue
- and is in no way binding on an implementation. Test suites
- should include assertions based on 1003.1 whether or not the
- methodology mentions it. Test Suites may not test something
- that is not specifically asserted in the base standard.
-
- Perhaps this discussion really all boils down to the quality
- of the test suite.
-
-
- Seth Rosenthal
-
- Disclaimer: All opinions are my own not my employers'.
-
-
- Volume-Number: Volume 31, Number 13
-
-