DELTA 116 0 338 SVNtX K 5]{\subsubsection{Test: #1} \noindent\textit{Purpose:} #2 \bigskip \noindent\textit{Setup:} #3 \bigskip \noindent\textit{Execution:} #4 \bigskip \noindent\textit{Evaluation:} #5} \begin{document} \svnInfo $Id$ \maketitle \section{Introduction} % motivate the document, briefly describe the module \subsection{Testing Framework} % find/describe framework \subsection{Simulation} % stubbed/simulated components, how it will be done \section{Test Cases} % describe format of test descriptions? \subsection{Requirements-Based} % cite reqs % briefly describe nature of acceptance tests % THE TESTS % === these tests are not automatable and should be run less! === % we hope to capture more of the problems with other forms of testing \test{Scraping Correctness} {Ensure that relevant information is extracted from course Web pages. This is stipulated by the first requirement for the WebImporter component \cite{spec}.} {Select a current Web page from a higher education institution listing assignments for the course. The page should be written in some structured format such as a list or table rather than prose. Repeat this process ten times to create a set of ten inputs to the test.} {Using the same functions that would be invoked if the UI were manipulated directly, request that Cue import each selected Web page into the database. (Note that, if the approach suggested by the \texttt{scraper.py} prototype is used, this operation will require human intervention.) Capture the information that Cue initially extracts from the page and present it to a user who has been made familiar with the input pages. The user rates the relevance of the extracted information on a Likert scale from $1$ to $7$. A score of $1$ indicates that no useful information is present; $3$ indicates that about half of the relevant information on the page has been extracted; $7$ indicates that all relevant information was extracted. ``Relevant'' information should be defined for the user as ``information necessary for a full description of any single assignment.''} {The test passes if and only if at most $1$ input page is given a $1$ rating and at least $5$ pages receive a rating of $5$ or greater.} \test{Updated Assignments} {Ensure the correct updating of assignment information as required in the specifications of WebImporter component \cite{spec}.} {A plausible but contrived Web page should be constructed as the test is written. It should be verified that Cue behaves well when importing the page, extracting all relevant information (a $7$ rating as above). Each data field in the page should be filled with distinct (not necessarily meaningful) text. When executing the test, import the page into Cue's database as described above.} {Change the first character in each field of the contrived Web page by incrementing its character code. In Cue, invoke a refresh of the database's assignment data; obtain the data extracted from the modified Web page.} {The test passes if and only if Cue's new database data exactly matches the modified fields in the Web page.} \test{New Assignments} {Verify the addition of new assignment information from course Web pages. This behavior is required by WebImporter component requirements \cite{spec}.} {As in the previous test, a Web page is constructed when the test is written that is shown to behave very well under Cue's importing functionality. Again, each field should be filled with distinct text. The page is imported into Cue's database using the procedure outlined above.} {Add an entry to the top of the contrived Web page by repeating the markup that delineates assignments in the page. Fill every field in the new assignment with text distinct from other fields in the new assignment and elsewhere in the page. Invoke a refresh of Cue's assignment database. Collect the assignment data extracted from the Web page.} {The test passes if and only if all old assignment information was preserved across the refresh and the new assignment was added. The new assignment's extracted fields must exactly match those that were added to the Web page.} \subsection{Specification-Based} % cite specif % "specified functionality that was not directly implied by the basic requirements" % THE TESTS \subsection{Design-Based} % cite design (prototype) % test detailed shit about impl % because a lot of work was put into impl of prototype, assume eventual impl is similar to prot % THE TESTS \begin{thebibliography}{99} \bibitem{reqs} La Motte-Mitchell, Andrew, Adrian Sampson, and Stephon Striplin, {\it Cue Requirements}. CS121 Project 2, February 27, 2007. \bibitem{arch} La Motte-Mitchell, Andrew, Adrian Sampson, and Stephon Striplin, {\it Cue Architecture}. CS121 Project 3, April 7, 2007. \bibitem{dsgn} Sampson, Adrian, {\it Cue: Assignment Page Scanning}. CS121 Project 3, April 7, 2007. \bibitem{spec} Striplin, Stephon, {\it Cue: Component Specifications: Importing}. CS121 Project 3, April 7, 2007. % cite testing framework resources \end{thebibliography} \end{document}ENDREP id: 20.0.r121/5175 type: file pred: 20.0.r120/292 count: 4 text: 121 0 5152 5336 f71a01ca082a5c021402b7cfff7ff9a0 props: 116 351 29 0 ff5c3c1f7bdb48ba0201950780ae7e31 cpath: /project4/sampson/test_cases.tex copyroot: 0 / PLAIN K 15 post-mortem.tex V 18 file 21.0.r118/510 K 14 test_cases.tex V 19 file 20.0.r121/5175 END ENDREP id: 1z.0.r121/5504 type: dir pred: 1z.0.r120/619 count: 5 text: 121 5397 94 94 eac0f4e0dd44ad021088df04f13c35c8 cpath: /project4/sampson copyroot: 0 / PLAIN K 15 lamottemitchell V 18 dir 1w.0.r115/6624 K 7 sampson V 18 dir 1z.0.r121/5504 END ENDREP id: 1v.0.r121/5754 type: dir pred: 1v.0.r120/867 count: 7 text: 121 5656 85 85 93527b978ab2015e2d297113a286ee0c cpath: /project4 copyroot: 0 / PLAIN K 8 project2 V 16 dir x.0.r41/3433 K 8 project3 V 17 dir y.0.r113/5763 K 8 project4 V 18 dir 1v.0.r121/5754 END ENDREP id: 0.0.r121/6023 type: dir pred: 0.0.r120/1134 count: 121 text: 121 5898 112 112 b5bae5c4208d22523691ef03ef528cb5 cpath: / copyroot: 0 / 20.0.t120-1 modify true false /project4/sampson/test_cases.tex 6023 6162