  | |  | Curious benchmarking results | Curious benchmarking results 2003-01-24 - By Rob Outar
no comments anyone? I would like to know if my results make sense...
Thanks,
Rob -----Original Message----- From: Rob Outar [mailto:routar@(protected)] Sent: Thursday, January 23, 2003 10:20 AM To: xerces-j-user@(protected) Subject: Curious benchmarking results
I recently used JProbe to do some benchmarking using Xerces 2, the results I got were sort of confusing.
Results:
Description Parsing time Memory usage
Description Parsing Time Memory Usage
Xerces 1.4.3
Validation and Namespace turned off
1:40 14879 kilobytes
(14.5 megabytes)
Xerces 1.4.3
Validation and Namespace turned on
2:56 34138 kilobytes
(33.3 megabytes)
Xerces 2
Validation and Namespace turned off
1:48 13987 kilobytes
(13.6 megabytes)
Xerces 2
Validation and Namespace turned on
3:20 14028 kilobytes
(13.7 megabytes)
There was not much memory difference with validation and namespaces on/off for Xerces 2. What I did notice is when validation and namespaces were on for Xerces 2, the garbage collector was invoked MANY, MANY, MANY, times.. this accounted for the low memory usage. Do these results seem valid?
Let me know your thoughts,
Rob
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <HTML xmlns:o = "urn:schemas-microsoft-com:office:office"><HEAD> <META http-equiv=Content-Type content="text/html; charset=us-ascii"> <META content="MSHTML 6.00.2800.1126" name=GENERATOR></HEAD> <BODY> <DIV><SPAN class=073561814-24012003><FONT face=Arial color=#0000ff size=2>no comments anyone? I would like to know if my results make sense...</FONT></SPAN></DIV> <DIV> </DIV> <DIV><FONT face=Arial size=2>Thanks,</FONT></DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=Arial size=2>Rob </FONT><FONT face=Tahoma size=2>-----Original Message-----<BR><B>From:</B> Rob Outar [mailto:routar@(protected)]<BR><B>Sent:</B> Thursday, January 23, 2003 10:20 AM<BR><B>To:</B> xerces-j-user@(protected)<BR><B>Subject:</B> Curious benchmarking results<BR><BR></FONT></DIV> <BLOCKQUOTE dir=ltr style="MARGIN-RIGHT: 0px"> <DIV><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2>I recently used JProbe to do some benchmarking using Xerces 2, the results I got were sort of confusing.</FONT></SPAN></DIV> <DIV><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2></FONT></SPAN> </DIV> <DIV><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2>Results: </FONT></SPAN></DIV> <DIV><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2></FONT></SPAN> </DIV> <DIV><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2> Description Parsing time   ; Memory usage</FONT></SPAN></DIV> <DIV><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2></FONT></SPAN> </DIV><SPAN class=427291215-23012003> <DIV align=center> <TABLE style="BORDER-RIGHT: medium none; BORDER-TOP: medium none; BORDER-LEFT: medium none; BORDER-BOTTOM: medium none; BORDER-COLLAPSE: collapse; mso-border -alt: solid black .75pt; mso-padding-alt: 0in 5.4pt 0in 5.4pt" cellSpacing=0 cellPadding=0 border=1> <THEAD> <TR style="HEIGHT: 12.3pt"> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : black 0.75pt solid; PADDING-LEFT: 5.4pt; BACKGROUND: black; PADDING-BOTTOM: 0in; BORDER-LEFT: black 0.75pt solid; WIDTH: 169.25pt; PADDING-TOP: 0in; BORDER -BOTTOM: black 0.75pt solid; HEIGHT: 12.3pt; mso-shading: white; mso-pattern: solid black" vAlign=top width=226> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><B style="mso-bidi-font-weight: normal"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Description<o:p></o :p></SPAN></B></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : black 0.75pt solid; PADDING-LEFT: 5.4pt; BACKGROUND: black; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH: 87.9pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 12.3pt; mso-shading: white; mso-pattern: solid black; mso-border-left-alt: solid black .75pt" vAlign=top width=117> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><B style="mso-bidi-font-weight: normal"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Parsing Time<o:p></o:p></SPAN></B></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : black 0.75pt solid; PADDING-LEFT: 5.4pt; BACKGROUND: black; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH: 127.65pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 12.3pt; mso-shading: white; mso-pattern: solid black; mso-border-left-alt: solid black .75pt" vAlign=top width=170> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><B style="mso-bidi-font-weight: normal"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Memory Usage<o:p></o:p></SPAN></B></P></TD></TR> <TR style="HEIGHT: 35.3pt"> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: black 0.75pt solid; WIDTH: 169.25pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-top-alt: solid black .75pt" vAlign=top width=226> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Xerces 1.4.3<o:p></o:p></SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Validation and Namespace turned <I>off</I><o:p></o:p></SPAN></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH : 87.9pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-left-alt: solid black .75pt; mso -border-top-alt: solid black .75pt" vAlign=top width=117> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt"> <o:p></o:p>< /SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">1:40<o:p></o:p>< /SPAN></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH : 127.65pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-left-alt: solid black .75pt; mso -border-top-alt: solid black .75pt" vAlign=top width=170> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">14879 kilobytes <o:p></o:p></SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">(14.5 megabytes)<o:p></o:p></SPAN></P></TD></TR> <TR style="HEIGHT: 35.3pt"> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: black 0.75pt solid; WIDTH: 169.25pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-top-alt: solid black .75pt" vAlign=top width=226> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Xerces 1.4.3<o:p></o:p></SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Validation and Namespace turned <I>on</I><o:p></o:p></SPAN></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH : 87.9pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-left-alt: solid black .75pt; mso -border-top-alt: solid black .75pt" vAlign=top width=117> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt"> <o:p></o:p>< /SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">2:56<o:p></o:p>< /SPAN></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH : 127.65pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-left-alt: solid black .75pt; mso -border-top-alt: solid black .75pt" vAlign=top width=170> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">34138 kilobytes<o:p></o:p></SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt"><SPAN style="mso-spacerun: yes"> </SPAN>(33.3 megabytes)<o:p></o:p></SPAN></P></TD></TR> <TR style="HEIGHT: 35.3pt"> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: black 0.75pt solid; WIDTH: 169.25pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-top-alt: solid black .75pt" vAlign=top width=226> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Xerces 2<o:p></o:p></SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Validation and Namespace turned <I>off</I><o:p></o:p></SPAN></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH : 87.9pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-left-alt: solid black .75pt; mso -border-top-alt: solid black .75pt" vAlign=top width=117> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt"> <o:p></o:p>< /SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">1:48<o:p></o:p>< /SPAN></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH : 127.65pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-left-alt: solid black .75pt; mso -border-top-alt: solid black .75pt" vAlign=top width=170> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">13987 kilobytes <o:p></o:p></SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">(13.6 megabytes)<o:p></o:p></SPAN></P></TD></TR> <TR style="HEIGHT: 35.3pt"> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: black 0.75pt solid; WIDTH: 169.25pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-top-alt: solid black .75pt" vAlign=top width=226> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Xerces 2<o:p></o:p></SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">Validation and Namespace turned <I>on</I><o:p></o:p></SPAN></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH : 87.9pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-left-alt: solid black .75pt; mso -border-top-alt: solid black .75pt" vAlign=top width=117> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt"> <o:p></o:p>< /SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">3:20<o:p></o:p>< /SPAN></P></TD> <TD style="BORDER-RIGHT: black 0.75pt solid; PADDING-RIGHT: 5.4pt; BORDER-TOP : #d4d0c8; PADDING-LEFT: 5.4pt; PADDING-BOTTOM: 0in; BORDER-LEFT: #d4d0c8; WIDTH : 127.65pt; PADDING-TOP: 0in; BORDER-BOTTOM: black 0.75pt solid; HEIGHT: 35.3pt; BACKGROUND-COLOR: transparent; mso-border-left-alt: solid black .75pt; mso -border-top-alt: solid black .75pt" vAlign=top width=170> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">14028 kilobytes <o:p></o:p></SPAN></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt; TEXT-ALIGN: center" align=center><SPAN style="FONT-SIZE: 10pt; mso-bidi-font-size: 12.0pt">(13.7 megabytes)<o:p></o:p></SPAN></P></TD></TR></THEAD> <TBODY></TBODY></TABLE></DIV> <DIV align=center><FONT face=Arial color=#0000ff size=2></FONT> </DIV> <DIV align=left><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2>There was not much memory difference with validation and namespaces on/off for Xerces 2. What I did notice is when validation and namespaces were on for Xerces 2, the garbage collector was invoked MANY, MANY, MANY, times.. this accounted for the low memory usage. Do these results seem valid?</FONT></SPAN></DIV> <DIV align=left><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2></FONT></SPAN> </DIV> <DIV align=left><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2>Let me know your thoughts,</FONT></SPAN></DIV> <DIV align=left><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2></FONT></SPAN> </DIV> <DIV align=left><SPAN class=427291215-23012003><FONT face=Arial color=#0000ff size=2>Rob </FONT></SPAN></DIV></SPAN> <DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV> <DIV><FONT face=Arial size=2></FONT> </DIV> <DIV><FONT face=sans-serif size=2><FONT color=#0000ff></FONT> </DIV></BLOCKQUOTE></FONT></BODY></HTML>
|
|
 |