Quantcast

Apache memory leak?

classic Classic list List threaded Threaded
17 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Apache memory leak?

KYLEE-2
Dear all,
 
 
I have lots of memory issues on my server after the latest update to my subversion server. I used to run a v1.5.5 server without much problems on my environment and rebooting the server from time to time is a must. It usually happens once every week. Now that i have updated the subversion server to the latest build provided by CollabNet due to a valuable fix to this version.
 
Ever since, i have to reboot the server once every 2 days due to non-responding clients and high memory consumption.

This is my setup:
- Collab.Net Subversion: Version 1.6.5-6, Release Date: September 8, 2009
- Windows Server 2003 with full updates with 2 GB of RAM.
- Repository size: 20GB.
- Have been using subversion for the past 5 years.
- Last integrity check was ok before the upgrade.
- httpd takes ~900MB of RAM and ~900MB of virtual memroy.
 
I do not know what's the reason or the cause of it. Sometimes svnadmin seems to be running heavily on the server taking up to 50% of the CPU time.
 
Has anyone experienced this after the server upgrade? What can i do to fix this? Please help. Thanks.
 
 
Regards,
Lee


This e-mail is confidential and may be read, copied and used only by the intended recipient. If you have received it in error, please contact the sender immediately by return e-mail. Please then delete the e-mail and do not disclose its contents to any other person.

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Apache memory leak?

Ulrich Eckhardt
On Monday 12 October 2009, [hidden email] wrote:
> I have lots of memory issues on my server after the latest update to my
> subversion server. I used to run a v1.5.5 server without much problems
> on my environment and rebooting the server from time to time is a must.
> It usually happens once every week.

Huh? That sounds really bad.

> Now that i have updated the subversion server to the latest build
> provided by CollabNet due to a valuable fix to this version.
>
> Ever since, i have to reboot the server once every 2 days due to
> non-responding clients and high memory consumption.

That sounds even worse!

Apropos: Do you have to reboot the machine or does it suffice to restart
Apache? The difference is important in order to make out the culprit.

> - httpd takes ~900MB of RAM and ~900MB of virtual memroy.

That sounds like a lot, but I don't know what else you are serving with Apache
there.

> I do not know what's the reason or the cause of it. Sometimes svnadmin
> seems to be running heavily on the server taking up to 50% of the CPU
> time.

Why is svnadmin running? Who started it and why? That should be a tool for
administration and maintenance, not something that regularly runs. The only
thing it is good for regularly is to create a dumpfile from a hotcopy for
backup purposes.

Uli

--
ML: http://subversion.tigris.org/mailing-list-guidelines.html
FAQ: http://subversion.tigris.org/faq.html
Docs: http://svnbook.red-bean.com/

Sator Laser GmbH
Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932

**************************************************************************************
Sator Laser GmbH, Fangdieckstraße 75a, 22547 Hamburg, Deutschland
Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932
**************************************************************************************
           Visit our website at <http://www.satorlaser.de/>
**************************************************************************************
Diese E-Mail einschließlich sämtlicher Anhänge ist nur für den Adressaten bestimmt und kann vertrauliche Informationen enthalten. Bitte benachrichtigen Sie den Absender umgehend, falls Sie nicht der beabsichtigte Empfänger sein sollten. Die E-Mail ist in diesem Fall zu löschen und darf weder gelesen, weitergeleitet, veröffentlicht oder anderweitig benutzt werden.
E-Mails können durch Dritte gelesen werden und Viren sowie nichtautorisierte Änderungen enthalten. Sator Laser GmbH ist für diese Folgen nicht verantwortlich.
**************************************************************************************

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2406714

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

KYLEE-2
Hi Uli,

Thanks for the reply. That's what i thought so. It's definitely high memory comsumption there.
I do not serve anything else for Apache. It's a dedicated subversion server via http and nothing else.

I have svnadmin running daily for backup. But when the backup service is not running, it's stuck in the process somehow.


Regards,
Lee

-----Original Message-----
From: Ulrich Eckhardt [mailto:[hidden email]]
Sent: Monday, October 12, 2009 6:03 PM
To: [hidden email]
Subject: Re: Apache memory leak?

On Monday 12 October 2009, [hidden email] wrote:
> I have lots of memory issues on my server after the latest update to my
> subversion server. I used to run a v1.5.5 server without much problems
> on my environment and rebooting the server from time to time is a must.
> It usually happens once every week.

Huh? That sounds really bad.

> Now that i have updated the subversion server to the latest build
> provided by CollabNet due to a valuable fix to this version.
>
> Ever since, i have to reboot the server once every 2 days due to
> non-responding clients and high memory consumption.

That sounds even worse!

Apropos: Do you have to reboot the machine or does it suffice to restart
Apache? The difference is important in order to make out the culprit.

> - httpd takes ~900MB of RAM and ~900MB of virtual memroy.

That sounds like a lot, but I don't know what else you are serving with Apache
there.

> I do not know what's the reason or the cause of it. Sometimes svnadmin
> seems to be running heavily on the server taking up to 50% of the CPU
> time.

Why is svnadmin running? Who started it and why? That should be a tool for
administration and maintenance, not something that regularly runs. The only
thing it is good for regularly is to create a dumpfile from a hotcopy for
backup purposes.

Uli

--
ML: http://subversion.tigris.org/mailing-list-guidelines.html
FAQ: http://subversion.tigris.org/faq.html
Docs: http://svnbook.red-bean.com/

Sator Laser GmbH
Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932

**************************************************************************************
Sator Laser GmbH, Fangdieckstraße 75a, 22547 Hamburg, Deutschland
Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932
**************************************************************************************
           Visit our website at <http://www.satorlaser.de/>
**************************************************************************************
Diese E-Mail einschließlich sämtlicher Anhänge ist nur für den Adressaten bestimmt und kann vertrauliche Informationen enthalten. Bitte benachrichtigen Sie den Absender umgehend, falls Sie nicht der beabsichtigte Empfänger sein sollten. Die E-Mail ist in diesem Fall zu löschen und darf weder gelesen, weitergeleitet, veröffentlicht oder anderweitig benutzt werden.
E-Mails können durch Dritte gelesen werden und Viren sowie nichtautorisierte Änderungen enthalten. Sator Laser GmbH ist für diese Folgen nicht verantwortlich.
**************************************************************************************

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2406714

To unsubscribe from this discussion, e-mail: [[hidden email]].
This e-mail is confidential and may be read, copied and used only by the intended recipient. If you have received it in error, please contact the sender immediately by return e-mail. Please then delete the e-mail and do not disclose its contents to any other person.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2406980

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

Tony Harverson-2
Are you perhaps triggering an svnadmin hotcopy (or something else) in a post-commit script for that repo?

Tony

>-----Original Message-----
>From: [hidden email] [mailto:[hidden email]]
>Sent: Tuesday, October 13, 2009 9:24 AM
>To: [hidden email]
>Subject: RE: Apache memory leak?
>
>Hi Uli,
>
>Thanks for the reply. That's what i thought so. It's
>definitely high memory comsumption there.
>I do not serve anything else for Apache. It's a dedicated
>subversion server via http and nothing else.
>
>I have svnadmin running daily for backup. But when the backup
>service is not running, it's stuck in the process somehow.
>
>
>Regards,
>Lee
>
>-----Original Message-----
>From: Ulrich Eckhardt [mailto:[hidden email]]
>Sent: Monday, October 12, 2009 6:03 PM
>To: [hidden email]
>Subject: Re: Apache memory leak?
>
>On Monday 12 October 2009, [hidden email] wrote:
>> I have lots of memory issues on my server after the latest update to
>> my subversion server. I used to run a v1.5.5 server without much
>> problems on my environment and rebooting the server from
>time to time is a must.
>> It usually happens once every week.
>
>Huh? That sounds really bad.
>
>> Now that i have updated the subversion server to the latest build
>> provided by CollabNet due to a valuable fix to this version.
>>
>> Ever since, i have to reboot the server once every 2 days due to
>> non-responding clients and high memory consumption.
>
>That sounds even worse!
>
>Apropos: Do you have to reboot the machine or does it suffice
>to restart Apache? The difference is important in order to
>make out the culprit.
>
>> - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
>
>That sounds like a lot, but I don't know what else you are
>serving with Apache there.
>
>> I do not know what's the reason or the cause of it.
>Sometimes svnadmin
>> seems to be running heavily on the server taking up to 50%
>of the CPU
>> time.
>
>Why is svnadmin running? Who started it and why? That should
>be a tool for administration and maintenance, not something
>that regularly runs. The only thing it is good for regularly
>is to create a dumpfile from a hotcopy for backup purposes.
>
>Uli
>
>--
>ML: http://subversion.tigris.org/mailing-list-guidelines.html
>FAQ: http://subversion.tigris.org/faq.html
>Docs: http://svnbook.red-bean.com/
>
>Sator Laser GmbH
>Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932
>
>***************************************************************
>***********************
>Sator Laser GmbH, Fangdieckstraße 75a, 22547 Hamburg, Deutschland
>Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932
>***************************************************************
>***********************
>           Visit our website at <http://www.satorlaser.de/>
>***************************************************************
>***********************
>Diese E-Mail einschließlich sämtlicher Anhänge ist nur für den
>Adressaten bestimmt und kann vertrauliche Informationen
>enthalten. Bitte benachrichtigen Sie den Absender umgehend,
>falls Sie nicht der beabsichtigte Empfänger sein sollten. Die
>E-Mail ist in diesem Fall zu löschen und darf weder gelesen,
>weitergeleitet, veröffentlicht oder anderweitig benutzt werden.
>E-Mails können durch Dritte gelesen werden und Viren sowie
>nichtautorisierte Änderungen enthalten. Sator Laser GmbH ist
>für diese Folgen nicht verantwortlich.
>***************************************************************
>***********************
>
>------------------------------------------------------
>http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&d
>sMessageId=2406714
>
>To unsubscribe from this discussion, e-mail:
>[[hidden email]].
>This e-mail is confidential and may be read, copied and used
>only by the intended recipient. If you have received it in
>error, please contact the sender immediately by return e-mail.
>Please then delete the e-mail and do not disclose its contents
>to any other person.
>
>------------------------------------------------------
>http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&d
>sMessageId=2406980
>
>To unsubscribe from this discussion, e-mail:
>[[hidden email]].
>

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2406986

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

Tony Butt
In reply to this post by KYLEE-2
On Tue, 2009-10-13 at 10:24 +0200, [hidden email] wrote:
> Hi Uli,
>
> Thanks for the reply. That's what i thought so. It's definitely high memory comsumption there.
> I do not serve anything else for Apache. It's a dedicated subversion server via http and nothing else.
>
The only time I have found excessive memory consumption with apache was
when I tried to use ldap authentication on apache 2.0. The memory usage
would creep up over a period of time, and eventually I had to restart
apache (every few days, or so, I think). I gave up on ldap and the
problem went away.

I have since used ldap authentication with apache 2.2, and there are no
problems there.

> I have svnadmin running daily for backup. But when the backup service is not running, it's stuck in the process somehow.
>
>
> Regards,
> Lee
>
> -----Original Message-----
> From: Ulrich Eckhardt [mailto:[hidden email]]
> Sent: Monday, October 12, 2009 6:03 PM
> To: [hidden email]
> Subject: Re: Apache memory leak?
>
> On Monday 12 October 2009, [hidden email] wrote:
> > I have lots of memory issues on my server after the latest update to my
> > subversion server. I used to run a v1.5.5 server without much problems
> > on my environment and rebooting the server from time to time is a must.
> > It usually happens once every week.
>
> Huh? That sounds really bad.
>
I agree - apache should normally not need to be rebooted for months at a
time (if ever)

> > Now that i have updated the subversion server to the latest build
> > provided by CollabNet due to a valuable fix to this version.
> >
> > Ever since, i have to reboot the server once every 2 days due to
> > non-responding clients and high memory consumption.
>
> That sounds even worse!
>
> Apropos: Do you have to reboot the machine or does it suffice to restart
> Apache? The difference is important in order to make out the culprit.
>
> > - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
>
Sounds like my ldap problem with 2.0, see above...

> That sounds like a lot, but I don't know what else you are serving with Apache
> there.
>
> > I do not know what's the reason or the cause of it. Sometimes svnadmin
> > seems to be running heavily on the server taking up to 50% of the CPU
> > time.
>
> Why is svnadmin running? Who started it and why? That should be a tool for
> administration and maintenance, not something that regularly runs. The only
> thing it is good for regularly is to create a dumpfile from a hotcopy for
> backup purposes.
>
> Uli
>
Tony Butt
CEA Technologies.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2407371

To unsubscribe from this discussion, e-mail: [[hidden email]].

signature.asc (196 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

Geoff Rowell-2
Tony Butt wrote:
> On Tue, 2009-10-13 at 10:24 +0200, [hidden email] wrote:
> > Hi Uli,
> >
> > Thanks for the reply. That's what i thought so. It's definitely high
memory comsumption there.
> > I do not serve anything else for Apache. It's a dedicated subversion
server via http and nothing else.
> >
> The only time I have found excessive memory consumption with apache was
when I tried to use ldap authentication on apache 2.0. The memory usage
would creep up over a period of time, and eventually I had to restart apache
(every few days, or so, I think). I gave up on ldap and the problem went
away.
>
> I have since used ldap authentication with apache 2.2, and there are no
problems there.
> > I have svnadmin running daily for backup. But when the backup service is
not running, it's stuck in the process somehow.

> >
> >
> > Regards,
> > Lee
> >
> > -----Original Message-----
> > From: Ulrich Eckhardt [mailto:[hidden email]]
> > Sent: Monday, October 12, 2009 6:03 PM
> > To: [hidden email]
> > Subject: Re: Apache memory leak?
> >
> > On Monday 12 October 2009, [hidden email] wrote:
> > > I have lots of memory issues on my server after the latest update to
> > > my subversion server. I used to run a v1.5.5 server without much
> > > problems on my environment and rebooting the server from time to time
is a must.
> > > It usually happens once every week.
> >
> > Huh? That sounds really bad.
> >
> I agree - apache should normally not need to be rebooted for months at a
time (if ever)

> > > Now that i have updated the subversion server to the latest build
> > > provided by CollabNet due to a valuable fix to this version.
> > >
> > > Ever since, i have to reboot the server once every 2 days due to
> > > non-responding clients and high memory consumption.
> >
> > That sounds even worse!
> >
> > Apropos: Do you have to reboot the machine or does it suffice to
> > restart Apache? The difference is important in order to make out the
culprit.

> >
> > > - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
> >
> Sounds like my ldap problem with 2.0, see above...
> > That sounds like a lot, but I don't know what else you are serving
> > with Apache there.
> >
> > > I do not know what's the reason or the cause of it. Sometimes
> > > svnadmin seems to be running heavily on the server taking up to 50%
> > > of the CPU time.
> >
> > Why is svnadmin running? Who started it and why? That should be a tool
> > for administration and maintenance, not something that regularly runs.
> > The only thing it is good for regularly is to create a dumpfile from a
> > hotcopy for backup purposes.
> >
> > Uli
>

I run the CollabNet Subversion Server 1.6.5 (on W2K3 R2) with basic
authentication and authz - nothing fancy - and I'm also seeing a gradual
increase in the virtual memory size of the Apache process. I've been
restarting Apache every couple of day to control the memory size.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2407547

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Apache memory leak?

Ivan Zhakov-2
In reply to this post by KYLEE-2
On Mon, Oct 12, 2009 at 4:01 PM,  <[hidden email]> wrote:

> Dear all,
>
>
> I have lots of memory issues on my server after the latest update to my
> subversion server. I used to run a v1.5.5 server without much problems on my
> environment and rebooting the server from time to time is a must. It usually
> happens once every week. Now that i have updated the subversion server to
> the latest build provided by CollabNet due to a valuable fix to this
> version.
>
> Ever since, i have to reboot the server once every 2 days due to
> non-responding clients and high memory consumption.
> This is my setup:
> - Collab.Net Subversion: Version 1.6.5-6, Release Date: September 8, 2009
> - Windows Server 2003 with full updates with 2 GB of RAM.
> - Repository size: 20GB.
> - Have been using subversion for the past 5 years.
> - Last integrity check was ok before the upgrade.
> - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
>
> I do not know what's the reason or the cause of it. Sometimes svnadmin seems
> to be running heavily on the server taking up to 50% of the CPU time.
>
> Has anyone experienced this after the server upgrade? What can i do to fix
> this? Please help. Thanks.
>
Do you use mod_deflate? There is known problem with latest Apache and
Subversion. See thread below:
http://groups.google.ru/group/subversion-development/browse_thread/thread/6d63ea3ba63872ad

--
Ivan Zhakov
VisualSVN Team

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2407621

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

Geoff Rowell-2
> Ivan Zhakov wrote:
> On Mon, Oct 12, 2009 at 4:01 PM,  <[hidden email]> wrote:
> > Dear all,
> >
> >
> > I have lots of memory issues on my server after the latest update to my
> > subversion server. I used to run a v1.5.5 server without much problems
on my
> > environment and rebooting the server from time to time is a must. It
usually
> > happens once every week. Now that i have updated the subversion server
to
> > the latest build provided by CollabNet due to a valuable fix to this
> > version.
> >
> > Ever since, i have to reboot the server once every 2 days due to
> > non-responding clients and high memory consumption.
> > This is my setup:
> > - Collab.Net Subversion: Version 1.6.5-6, Release Date: September 8,
2009
> > - Windows Server 2003 with full updates with 2 GB of RAM.
> > - Repository size: 20GB.
> > - Have been using subversion for the past 5 years.
> > - Last integrity check was ok before the upgrade.
> > - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
> >
> > I do not know what's the reason or the cause of it. Sometimes svnadmin
seems
> > to be running heavily on the server taking up to 50% of the CPU time.
> >
> > Has anyone experienced this after the server upgrade? What can i do to
fix
> > this? Please help. Thanks.
> >
> Do you use mod_deflate? There is known problem with latest Apache and
> Subversion. See thread below:
>
http://groups.google.ru/group/subversion-development/browse_thread/thread/6d
63ea3ba63872ad
>

Nope. It's really basic.

-Geoff

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2407630

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Apache memory leak?

Ivan Zhakov-2
On Wed, Oct 14, 2009 at 8:22 PM, Geoff Rowell <[hidden email]> wrote:

>> Ivan Zhakov wrote:
>> On Mon, Oct 12, 2009 at 4:01 PM,  <[hidden email]> wrote:
>> > Dear all,
>> >
>> >
>> > I have lots of memory issues on my server after the latest update to my
>> > subversion server. I used to run a v1.5.5 server without much problems
> on my
>> > environment and rebooting the server from time to time is a must. It
> usually
>> > happens once every week. Now that i have updated the subversion server
> to
>> > the latest build provided by CollabNet due to a valuable fix to this
>> > version.
>> >
>> > Ever since, i have to reboot the server once every 2 days due to
>> > non-responding clients and high memory consumption.
>> > This is my setup:
>> > - Collab.Net Subversion: Version 1.6.5-6, Release Date: September 8,
> 2009
>> > - Windows Server 2003 with full updates with 2 GB of RAM.
>> > - Repository size: 20GB.
>> > - Have been using subversion for the past 5 years.
>> > - Last integrity check was ok before the upgrade.
>> > - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
>> >
>> > I do not know what's the reason or the cause of it. Sometimes svnadmin
> seems
>> > to be running heavily on the server taking up to 50% of the CPU time.
>> >
>> > Has anyone experienced this after the server upgrade? What can i do to
> fix
>> > this? Please help. Thanks.
>> >
>> Do you use mod_deflate? There is known problem with latest Apache and
>> Subversion. See thread below:
>>
> http://groups.google.ru/group/subversion-development/browse_thread/thread/6d
> 63ea3ba63872ad
>>
>
> Nope. It's really basic.
>
Ok. Next thing that you should try is configure MaxMemFree option to
some lower value. In our VisualSVN Server setting "MaxMemFree 100"
significantly dropped memory usage.

--
Ivan Zhakov
VisualSVN Team

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2407634

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Apache memory leak?

Les Mikesell-2
In reply to this post by Geoff Rowell-2
Geoff Rowell wrote:

>>
>>> Has anyone experienced this after the server upgrade? What can i do to
> fix
>>> this? Please help. Thanks.
>>>
>> Do you use mod_deflate? There is known problem with latest Apache and
>> Subversion. See thread below:
>>
> http://groups.google.ru/group/subversion-development/browse_thread/thread/6d
> 63ea3ba63872ad
>
> Nope. It's really basic.
>

If apache is using the prefork model, you should be able to force the
child processes to each restart after some number of connections to work
around memory leaks in any module without much impact.

--
   Les Mikesell
    [hidden email]

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2407638

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

KYLEE-2
In reply to this post by Tony Harverson-2
Hi Tony,

Sorry for the late reply. Yes, i run python post commit scripts in that repo.
But how would that make the high memory consumption?

Regards,
Lee

-----Original Message-----
From: Tony Harverson [mailto:[hidden email]]
Sent: Tuesday, October 13, 2009 10:44 AM
To: [hidden email]
Subject: RE: Apache memory leak?

Are you perhaps triggering an svnadmin hotcopy (or something else) in a post-commit script for that repo?

Tony

>-----Original Message-----
>From: [hidden email] [mailto:[hidden email]]
>Sent: Tuesday, October 13, 2009 9:24 AM
>To: [hidden email]
>Subject: RE: Apache memory leak?
>
>Hi Uli,
>
>Thanks for the reply. That's what i thought so. It's
>definitely high memory comsumption there.
>I do not serve anything else for Apache. It's a dedicated
>subversion server via http and nothing else.
>
>I have svnadmin running daily for backup. But when the backup
>service is not running, it's stuck in the process somehow.
>
>
>Regards,
>Lee
>
>-----Original Message-----
>From: Ulrich Eckhardt [mailto:[hidden email]]
>Sent: Monday, October 12, 2009 6:03 PM
>To: [hidden email]
>Subject: Re: Apache memory leak?
>
>On Monday 12 October 2009, [hidden email] wrote:
>> I have lots of memory issues on my server after the latest update to
>> my subversion server. I used to run a v1.5.5 server without much
>> problems on my environment and rebooting the server from
>time to time is a must.
>> It usually happens once every week.
>
>Huh? That sounds really bad.
>
>> Now that i have updated the subversion server to the latest build
>> provided by CollabNet due to a valuable fix to this version.
>>
>> Ever since, i have to reboot the server once every 2 days due to
>> non-responding clients and high memory consumption.
>
>That sounds even worse!
>
>Apropos: Do you have to reboot the machine or does it suffice
>to restart Apache? The difference is important in order to
>make out the culprit.
>
>> - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
>
>That sounds like a lot, but I don't know what else you are
>serving with Apache there.
>
>> I do not know what's the reason or the cause of it.
>Sometimes svnadmin
>> seems to be running heavily on the server taking up to 50%
>of the CPU
>> time.
>
>Why is svnadmin running? Who started it and why? That should
>be a tool for administration and maintenance, not something
>that regularly runs. The only thing it is good for regularly
>is to create a dumpfile from a hotcopy for backup purposes.
>
>Uli
>
>--
>ML: http://subversion.tigris.org/mailing-list-guidelines.html
>FAQ: http://subversion.tigris.org/faq.html
>Docs: http://svnbook.red-bean.com/
>
>Sator Laser GmbH
>Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932
>
>***************************************************************
>***********************
>Sator Laser GmbH, Fangdieckstraße 75a, 22547 Hamburg, Deutschland
>Geschäftsführer: Thorsten Föcking, Amtsgericht Hamburg HR B62 932
>***************************************************************
>***********************
>           Visit our website at <http://www.satorlaser.de/>
>***************************************************************
>***********************
>Diese E-Mail einschließlich sämtlicher Anhänge ist nur für den
>Adressaten bestimmt und kann vertrauliche Informationen
>enthalten. Bitte benachrichtigen Sie den Absender umgehend,
>falls Sie nicht der beabsichtigte Empfänger sein sollten. Die
>E-Mail ist in diesem Fall zu löschen und darf weder gelesen,
>weitergeleitet, veröffentlicht oder anderweitig benutzt werden.
>E-Mails können durch Dritte gelesen werden und Viren sowie
>nichtautorisierte Änderungen enthalten. Sator Laser GmbH ist
>für diese Folgen nicht verantwortlich.
>***************************************************************
>***********************
>
>------------------------------------------------------
>http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&d
>sMessageId=2406714
>
>To unsubscribe from this discussion, e-mail:
>[[hidden email]].
>This e-mail is confidential and may be read, copied and used
>only by the intended recipient. If you have received it in
>error, please contact the sender immediately by return e-mail.
>Please then delete the e-mail and do not disclose its contents
>to any other person.
>
>------------------------------------------------------
>http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&d
>sMessageId=2406980
>
>To unsubscribe from this discussion, e-mail:
>[[hidden email]].
>

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2406986

To unsubscribe from this discussion, e-mail: [[hidden email]].
This e-mail is confidential and may be read, copied and used only by the intended recipient. If you have received it in error, please contact the sender immediately by return e-mail. Please then delete the e-mail and do not disclose its contents to any other person.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2416054

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

KYLEE-2
In reply to this post by Tony Butt
Hi Tony,


Yes, that's my problem too. I have to reboot every few days.

This is my server signature: Server: Apache/2.2.13 (Win32) DAV/2
SVN/1.6.5 mod_auth_sspi/1.0.4

I run it on Windows Server 2003, with LDAP authentication.
Still the high memory consumption with Apache 2.2. I don't remember if
the problem is there when it's still operating under Apache 2.0.


Regards,
Lee

-----Original Message-----
From: Tony Butt [mailto:[hidden email]]
Sent: Wednesday, October 14, 2009 2:50 AM
To: [hidden email]
Subject: RE: Apache memory leak?

On Tue, 2009-10-13 at 10:24 +0200, [hidden email] wrote:
> Hi Uli,
>
> Thanks for the reply. That's what i thought so. It's definitely high
memory comsumption there.
> I do not serve anything else for Apache. It's a dedicated subversion
server via http and nothing else.
>
The only time I have found excessive memory consumption with apache was
when I tried to use ldap authentication on apache 2.0. The memory usage
would creep up over a period of time, and eventually I had to restart
apache (every few days, or so, I think). I gave up on ldap and the
problem went away.

I have since used ldap authentication with apache 2.2, and there are no
problems there.
> I have svnadmin running daily for backup. But when the backup service
is not running, it's stuck in the process somehow.

>
>
> Regards,
> Lee
>
> -----Original Message-----
> From: Ulrich Eckhardt [mailto:[hidden email]]
> Sent: Monday, October 12, 2009 6:03 PM
> To: [hidden email]
> Subject: Re: Apache memory leak?
>
> On Monday 12 October 2009, [hidden email] wrote:
> > I have lots of memory issues on my server after the latest update to
my
> > subversion server. I used to run a v1.5.5 server without much
problems
> > on my environment and rebooting the server from time to time is a
must.
> > It usually happens once every week.
>
> Huh? That sounds really bad.
>
I agree - apache should normally not need to be rebooted for months at a
time (if ever)
> > Now that i have updated the subversion server to the latest build
> > provided by CollabNet due to a valuable fix to this version.
> >
> > Ever since, i have to reboot the server once every 2 days due to
> > non-responding clients and high memory consumption.
>
> That sounds even worse!
>
> Apropos: Do you have to reboot the machine or does it suffice to
restart
> Apache? The difference is important in order to make out the culprit.
>
> > - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
>
Sounds like my ldap problem with 2.0, see above...
> That sounds like a lot, but I don't know what else you are serving
with Apache
> there.
>
> > I do not know what's the reason or the cause of it. Sometimes
svnadmin
> > seems to be running heavily on the server taking up to 50% of the
CPU
> > time.
>
> Why is svnadmin running? Who started it and why? That should be a tool
for
> administration and maintenance, not something that regularly runs. The
only
> thing it is good for regularly is to create a dumpfile from a hotcopy
for
> backup purposes.
>
> Uli
>

Tony Butt
CEA Technologies.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageI
d=2407371

To unsubscribe from this discussion, e-mail:
[[hidden email]].
This e-mail is confidential and may be read, copied and used only by the intended recipient. If you have received it in error, please contact the sender immediately by return e-mail. Please then delete the e-mail and do not disclose its contents to any other person.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2416059

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

KYLEE-2
In reply to this post by Ivan Zhakov-2
Hi Ivan Zhakov,


No, i do not use mod_deflate in my server setting. Thanks for the tip.
Any idea?


Regards,
Lee

-----Original Message-----
From: Ivan Zhakov [mailto:[hidden email]]
Sent: Wednesday, October 14, 2009 5:58 PM
To: Lee, Khang Yeen
Cc: [hidden email]
Subject: Re: Apache memory leak?

On Mon, Oct 12, 2009 at 4:01 PM,  <[hidden email]> wrote:
> Dear all,
>
>
> I have lots of memory issues on my server after the latest update to
my
> subversion server. I used to run a v1.5.5 server without much problems
on my
> environment and rebooting the server from time to time is a must. It
usually
> happens once every week. Now that i have updated the subversion server
to
> the latest build provided by CollabNet due to a valuable fix to this
> version.
>
> Ever since, i have to reboot the server once every 2 days due to
> non-responding clients and high memory consumption.
> This is my setup:
> - Collab.Net Subversion: Version 1.6.5-6, Release Date: September 8,
2009
> - Windows Server 2003 with full updates with 2 GB of RAM.
> - Repository size: 20GB.
> - Have been using subversion for the past 5 years.
> - Last integrity check was ok before the upgrade.
> - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
>
> I do not know what's the reason or the cause of it. Sometimes svnadmin
seems
> to be running heavily on the server taking up to 50% of the CPU time.
>
> Has anyone experienced this after the server upgrade? What can i do to
fix
> this? Please help. Thanks.
>
Do you use mod_deflate? There is known problem with latest Apache and
Subversion. See thread below:
http://groups.google.ru/group/subversion-development/browse_thread/threa
d/6d63ea3ba63872ad

--
Ivan Zhakov
VisualSVN Team
This e-mail is confidential and may be read, copied and used only by the intended recipient. If you have received it in error, please contact the sender immediately by return e-mail. Please then delete the e-mail and do not disclose its contents to any other person.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2416063

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Apache memory leak?

Ivan Zhakov-2
On Tue, Nov 10, 2009 at 12:06 PM,  <[hidden email]> wrote:
> Hi Ivan Zhakov,
>
>
> No, i do not use mod_deflate in my server setting. Thanks for the tip.
> Any idea?
>
>
Check the MaxMemFree directive. Changing MaxMemFree to lower values
like 600 reduced memory usage significantly.


--
Ivan Zhakov
VisualSVN Team

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2416085

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak?

Geoff Rowell-2
In reply to this post by KYLEE-2
Hi Lee,

I added a "MaxMemFree" directive to "httpd.conf". Haven't had a problem
since then.

No one offered a reason why the problem suddenly appeared when I upgraded to
1.6.x.

-Geoff

-----Original Message-----
From: [hidden email] [mailto:[hidden email]]
Sent: Tuesday, November 10, 2009 4:05 AM
To: [hidden email]
Subject: RE: Apache memory leak?

Hi Geoff Rowell,

Thanks for the reply. I had the same problem too.
Do you have a solution to overcome this?

Regards,
Lee

-----Original Message-----
From: Geoff Rowell [mailto:[hidden email]]
Sent: Wednesday, October 14, 2009 3:54 PM
To: 'Tony Butt'
Cc: [hidden email]
Subject: RE: Apache memory leak?

Tony Butt wrote:
> On Tue, 2009-10-13 at 10:24 +0200, [hidden email] wrote:
> > Hi Uli,
> >
> > Thanks for the reply. That's what i thought so. It's definitely high
memory comsumption there.
> > I do not serve anything else for Apache. It's a dedicated subversion
server via http and nothing else.
> >
> The only time I have found excessive memory consumption with apache
was
when I tried to use ldap authentication on apache 2.0. The memory usage
would creep up over a period of time, and eventually I had to restart
apache
(every few days, or so, I think). I gave up on ldap and the problem went
away.
>
> I have since used ldap authentication with apache 2.2, and there are
no
problems there.
> > I have svnadmin running daily for backup. But when the backup
service is
not running, it's stuck in the process somehow.

> >
> >
> > Regards,
> > Lee
> >
> > -----Original Message-----
> > From: Ulrich Eckhardt [mailto:[hidden email]]
> > Sent: Monday, October 12, 2009 6:03 PM
> > To: [hidden email]
> > Subject: Re: Apache memory leak?
> >
> > On Monday 12 October 2009, [hidden email] wrote:
> > > I have lots of memory issues on my server after the latest update
to
> > > my subversion server. I used to run a v1.5.5 server without much
> > > problems on my environment and rebooting the server from time to
time
is a must.
> > > It usually happens once every week.
> >
> > Huh? That sounds really bad.
> >
> I agree - apache should normally not need to be rebooted for months at
a
time (if ever)

> > > Now that i have updated the subversion server to the latest build
> > > provided by CollabNet due to a valuable fix to this version.
> > >
> > > Ever since, i have to reboot the server once every 2 days due to
> > > non-responding clients and high memory consumption.
> >
> > That sounds even worse!
> >
> > Apropos: Do you have to reboot the machine or does it suffice to
> > restart Apache? The difference is important in order to make out the
culprit.
> >
> > > - httpd takes ~900MB of RAM and ~900MB of virtual memroy.
> >
> Sounds like my ldap problem with 2.0, see above...
> > That sounds like a lot, but I don't know what else you are serving
> > with Apache there.
> >
> > > I do not know what's the reason or the cause of it. Sometimes
> > > svnadmin seems to be running heavily on the server taking up to
50%
> > > of the CPU time.
> >
> > Why is svnadmin running? Who started it and why? That should be a
tool
> > for administration and maintenance, not something that regularly
runs.
> > The only thing it is good for regularly is to create a dumpfile from
a
> > hotcopy for backup purposes.
> >
> > Uli
>

I run the CollabNet Subversion Server 1.6.5 (on W2K3 R2) with basic
authentication and authz - nothing fancy - and I'm also seeing a gradual
increase in the virtual memory size of the Apache process. I've been
restarting Apache every couple of day to control the memory size.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageI
d=2407547

To unsubscribe from this discussion, e-mail:
[[hidden email]].
This e-mail is confidential and may be read, copied and used only by the
intended recipient. If you have received it in error, please contact the
sender immediately by return e-mail. Please then delete the e-mail and do
not disclose its contents to any other person.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2416156

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Apache memory leak?

Stefan Sperling
On Tue, Nov 10, 2009 at 09:22:36AM -0500, Geoff Rowell wrote:
> Hi Lee,
>
> I added a "MaxMemFree" directive to "httpd.conf". Haven't had a problem
> since then.

Great!

> No one offered a reason why the problem suddenly appeared when I upgraded to
> 1.6.x.

That's because no one has had the time to reproduce and debug the
issue and pin-point what is causing it.

It could of course be a new memory leak somewhere in the Subversion
libraries, we've have found memory leaks in Subversion before.
But it could also be something else. We just don't know yet.

Stefan

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2416165

To unsubscribe from this discussion, e-mail: [[hidden email]].
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Apache memory leak? FIXED

KYLEE-2
In reply to this post by Ivan Zhakov-2
Hi Ivan,


Thank you. It worked after adding MaxMemFree directive.


Regards,
Lee

-----Original Message-----
From: Ivan Zhakov [mailto:[hidden email]]
Sent: Tuesday, November 10, 2009 11:30 AM
To: Lee, Khang Yeen
Cc: [hidden email]
Subject: Re: Apache memory leak?

On Tue, Nov 10, 2009 at 12:06 PM,  <[hidden email]> wrote:
> Hi Ivan Zhakov,
>
>
> No, i do not use mod_deflate in my server setting. Thanks for the tip.
> Any idea?
>
>
Check the MaxMemFree directive. Changing MaxMemFree to lower values
like 600 reduced memory usage significantly.


--
Ivan Zhakov
VisualSVN Team
This e-mail is confidential and may be read, copied and used only by the intended recipient. If you have received it in error, please contact the sender immediately by return e-mail. Please then delete the e-mail and do not disclose its contents to any other person.

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=1065&dsMessageId=2417472

To unsubscribe from this discussion, e-mail: [[hidden email]].
Loading...