# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000001800057d0, pid=2252, tid=6056 # # Problematic frame: # C [tcnative-1.dll+0x57d0] –Tomcat 7.0 Crash

Posted on by sreekanth

We found Tomcat crashing (once a week) occasionally and here is the excerpt of the log

==================================================================================

2015-08-27 22:36:50 Commons Daemon procrun stdout initialized
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000001800057d0, pid=2252, tid=6056
#
# JRE version: Java(TM) SE Runtime Environment (7.0_80-b15) (build 1.7.0_80-b15)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.80-b11 mixed mode windows-amd64 compressed oops)
# Problematic frame:
# C  [tcnative-1.dll+0x57d0]
#
# Core dump written. Default location: D:\Tomcat 7.0\hs_err_pid2252.mdmp
#
# An error report file with more information is saved as:
# D:\Tomcat 7.0\hs_err_pid2252.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
ntialService.getCredential(CredentialService.java:611)
at com.documentum.web.env.CredentialService.getUsername(CredentialService.java:168)
at com.documentum.web.formext.session.SavedCredentialsAuthenticationScheme.authenticate(SavedCredentialsAuthenticationScheme.java:91)
at com.documentum.web.formext.session.AuthenticationService.authenticate(Unknown Source)
at com.documentum.wp.session.WpAuthenticationService.authenticate(WpAuthenticationService.java:28)
at com.documentum.web.formext.component.ComponentDispatcher.createComponentDef(Unknown Source)
at com.documentum.web.formext.component.ComponentDispatcher.mapRequestToComponent(Unknown Source)
at com.documentum.web.formext.component.ComponentDispatcher.doPost(Unknown Source)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:647)
at com.documentum.web.formext.component.ComponentDispatcher.doService(Unknown Source)
at com.documentum.web.formext.component.ComponentDispatcher.serviceAsNonController(Unknown Source)
at com.documentum.web.formext.component.ComponentDispatcher.service(Unknown Source)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.documentum.web.servlet.ResponseHeaderControlFilter.doFilter(ResponseHeaderControlFilter.java:348)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.documentum.web.servlet.CompressionFilter.doFilter(CompressionFilter.java:84)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at com.documentum.web.env.WDKController.processRequest(Unknown Source)
at com.documentum.web.env.WDKController.doFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
at org.apache.tomcat.util.net.AprEndpoint$SocketProcessor.run(AprEndpoint.java:1822)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)

==================================================================================================

As you can see it is pointing us to tcnative-1.dll. This is the DLL we added to tomcat a while ago for improving performance.

http://tomcat.apache.org/native-doc/

Then we looked at the dump files — hs_err_pid2252.mdmp and here is what we found

========================================================

Stack: [0x000000001bdc0000,0x000000001bec0000],  sp=0x000000001bebe330,  free space=1016k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [tcnative-1.dll+0x57d0]

[error occurred during error reporting (printing native stack), id 0xc0000005]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  org.apache.tomcat.jni.Socket.sendbb(JII)I+0
j  org.apache.coyote.http11.InternalAprOutputBuffer.flushBuffer()V+22
J 5791 C2 org.apache.coyote.http11.AbstractHttp11Processor.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V (514 bytes) @ 0x0000000002213e24 [0x0000000002213bc0+0x264]
J 2021 C2 org.apache.coyote.Response.action(Lorg/apache/coyote/ActionCode;Ljava/lang/Object;)V (37 bytes) @ 0x000000000185a350 [0x000000000185a300+0x50]
j  org.apache.catalina.connector.OutputBuffer.doFlush(Z)V+101
j  org.apache.catalina.connector.OutputBuffer.flush()V+2
j  org.apache.catalina.connector.CoyoteOutputStream.flush()V+4
j  com.documentum.ucf.server.transport.impl.ServerSession.sendAttachments(Ljava/io/OutputStream;)V+2258
j  com.documentum.ucf.server.transport.impl.ServerSession.executeInternal(Z)Lcom/documentum/ucf/server/transport/IRequestResponseIterator;+1456
j  com.documentum.ucf.server.transport.impl.ServerSession.execute(Z)Lcom/documentum/ucf/server/transport/IRequestResponseIterator;+59
j  com.documentum.ucf.server.transport.impl.UCFCommManager.finishSession(Lcom/documentum/ucf/server/transport/IServerSession;)V+484
j  com.documentum.web.contentxfer.ucf.UcfSessionManager.disconnectSession(Lcom/documentum/ucf/server/transport/IServerSession;)V+17
j  com.documentum.web.contentxfer.ucf.UcfSessionManager.release(Lcom/documentum/ucf/server/transport/IServerSession;)V+90
j  com.documentum.web.contentxfer.ucf.UcfContentTransport.releaseUcfSession()V+25
J 6258 C2 com.documentum.web.contentxfer.ContentTransferService.execute()V (440 bytes) @ 0x00000000023eba48 [0x00000000023eb120+0x928]
j  com.documentum.web.contentxfer.JobAdapter.execute(Lcom/documentum/fc/client/IDfSessionManager;Ljava/lang/String;)Z+20
j  com.documentum.job.async.AsyncJobManager$AsyncTimerJob.executeJob()V+40
j  com.documentum.job.async.AsyncJobManager$AsyncTimerJob.run()V+37
J 3494 C2 java.util.TimerThread.mainLoop()V (232 bytes) @ 0x0000000001d8b410 [0x0000000001d8b3c0+0x50]
j  java.util.TimerThread.run()V+1
v  ~StubRoutines::call_stub

================================================================================

I spent couple of hours looking through the Tomcat bugs/ Known issues that related to Tomcat Native Library component but had no luck.

Then, luckily I found following EMC note.

https://community.emc.com/docs/DOC-42889

Which seems to be the exact error I have in core dump. The Resolution was to

Add this properties org.apache.catalina.connector.RECYCLE_FACADES=true to tomcat/conf/catalina.properties file and restart the application server according to http://wiki.apache.org/tomcat/FAQ/KnownIssues#ImageIOIssues.

2 thoughts on “# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000001800057d0, pid=2252, tid=6056 # # Problematic frame: # C [tcnative-1.dll+0x57d0] –Tomcat 7.0 Crash”

  2. Thanks , I have just been searching for info approximately this topic for
    ages and yours is the best I’ve discovered till now.
    However, what in regards to the bottom line? Are
    you sure in regards to the supply?

    Reply

  5. Fantastic material. Cheers!
    http://canadianpharmacyntx.com/
    canadian pharmacy online canada canadian online pharmacies best online pharmacy stores canada pharmaceutical online ordering
    pharmacies near me
    pharmacy drug store
    trusted overseas pharmacies
    international pharmacies that ship to the usa
    canadian online pharmacies
    rx price comparison

    Reply

  6. Truly a lot of fantastic advice.
    http://canadianpharmacyntx.com/
    prescription drugs canada north west pharmacy canada no prescription pharmacies mexican pharmacies shipping to usa
    canada pharmacies prescription drugs
    global pharmacy canada
    canadian online pharmacy
    canada pharmacies online
    discount drugs online pharmacy
    onlinecanadianpharmacy.com

    Reply

  14. You have made your position quite effectively.!
    http://canadianpharmacymim.com/
    international pharmacies that ship to the usa canadianpharmacy canadian pharmacies that ship to us canadian online pharmacy
    pharmacy online store
    canadian pharmacy 365
    discount pharmaceuticals
    pharmacy prescription
    canada pharmacies
    canadian pharcharmy online

    Reply

  15. Wonderful postings. Thanks a lot!
    http://canadianonlinepharmacynnm.com/
    prescription price comparison canada online pharmacies prescription drug cost canada pharmaceuticals online
    canadapharmacyonline com
    canadian pharmacies online prescriptions
    canadian pharmacy no prescription
    prescription drugs prices
    canada pharmacy online orders
    pharmacy cost comparison

    Reply

  17. Wow many of very good advice.
    https://nicktambone.com/
    canadian pharmacy reviews canada pharmaceutical online ordering mexican pharmacies shipping to usa canada online pharmacies
    canadian prescription drugstore
    prescription drugs online without
    mexican pharmacy online medications
    pharmacy tech
    candrugstore com
    canadian pharmacies that ship to us

    Reply

  18. You stated that well.
    http://canadianpharmacyntx.com/
    best online pharmacy stores canada drugs online mexican pharmacy online medications london drugs canada
    drugs from canada
    prescription price comparison
    canada online pharmacies
    discount drugs online pharmacy
    mexican pharmacy online medications
    canadian online pharmacies prescription drugs

    Reply

  27. Many thanks, A good amount of forum posts!
    http://talahicc.com/
    canadian pharmacies without prescriptions canadian pharmacies cheap canadian drugs canadian pharmacies-24h
    canada pharmacies prescription drugs
    canada drugs
    canadian pharmacy without prescription
    buy prescription drugs without doctor
    online pharmacies no prescription
    online pharmacies canada

    Reply

  29. Cheers, Quite a lot of content.
    http://canadianonlinepharmacynnm.com/
    canada pharmacies prescription drugs london drugs canada canadian drugs without prescription canadian cialis
    prescription drugs without prior prescription
    best online pharmacies canada
    online drugstore
    online canadian discount pharmacy
    best online pharmacy stores
    online pharmacies no prescription

    Reply

  34. You’ve made your position pretty well!!
    http://talahicc.com/
    canada pharmacies online canadian pharmacy online best online pharmacies no prescription canadian pharmacies-24h
    discount prescription drugs online
    canadian pharmacy reviews
    medical information online
    canadian pharmacies top best
    drugs online
    best non prescription online pharmacies

    Reply

  36. Wow tons of superb tips.
    http://canadianpharmacysilo.com/
    pharmacy tech canadian pharmacies that ship to us price prescription drugs trust pharmacy canada
    buying drugs canada
    canadian prescription drugstore
    buy prescription drugs online
    canadian prescriptions
    prescription drugs without doctor approval
    buy prescription drugs without doctor

    Reply

  37. Thank you, An abundance of write ups.
    http://canadianpharmacymim.com/
    canadian pharmacies shipping to usa canadian pharmacies online compare prescription prices trust pharmacy canada
    pharmacy without dr prescriptions
    no prescription pharmacies
    no prescription online pharmacy
    canadian pharmacy reviews
    canadian online pharmacies
    canada pharmacies online prescriptions

    Reply

  41. Incredible many of valuable material.
    http://canadianpharmacysilo.com/
    canadian online pharmacy canadian pharmacies prescription cost comparison mexican pharmacies shipping to usa
    pain meds online without doctor prescription
    pharmacy prices compare
    best non prescription online pharmacies
    discount drugs online pharmacy
    canada meds
    best canadian prescription prices

    Reply

  43. Regards. I like this.
    http://canadianpharmaciescubarx.com/
    canada pharmacy online reviews global pharmacy canada canadian pharmacy without prescription top rated canadian pharmacies online
    pharmacy prices compare
    price prescription drugs
    approved canadian pharmacies online
    prescription drugs online without doctor
    canadian drug stores online
    online prescription drugs

    Reply

  54. Thank you! Loads of advice!
    http://canadianpharmaciesnnm.com/
    canadian pharmacies that are legit north west pharmacy canada us pharmacy no prior prescription online pharmacies canada
    no prescription pharmacies
    overseas pharmacies
    online pharmacy without a prescription
    board of pharmacy
    compare prescription prices
    pharmacy without dr prescriptions

    Reply

  55. With thanks, A good amount of knowledge.
    http://talahicc.com/
    most reliable canadian pharmacies online pharmacies of canada discount pharmacy online canadian online pharmacies
    prescription cost comparison
    the canadian pharmacy
    rx online
    cialis canadian pharmacy
    prescription drugs online without doctor
    legitimate canadian mail order pharmacies

    Reply

  59. Thank you, Ample content!
    http://canadianpharmacyntx.com/
    most reliable canadian pharmacies northwest pharmacy mexican pharmacy online canadian pharmacies-24h
    canadian online pharmacies prescription drugs
    best online canadian pharcharmy
    highest rated canadian pharmacies
    cheap prescription drugs online
    drug stores near me
    price prescription drugs

    Reply

  60. Whoa quite a lot of amazing tips.
    http://canadianpharmaciescubarx.com/
    online pharmacy without prescription online pharmacies canada canada pharmacies prescription drugs canadian pharmacies-24h
    no prior prescription required pharmacy
    canadian drug store
    online pharmacies no prescription
    canadian pharmacies without prescriptions
    online drugstore
    drug price

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *