URGENT

Everything related to the code /
Tout ce qui touche au code
Post Reply
User avatar
AF
Administrateur - Site Admin
Posts: 139
Joined: Thu Dec 28, 2006 8:19 pm
Location: NW UK
Contact:

URGENT

Post by AF » Tue Jul 01, 2008 2:40 pm

Code: Select all

Black Liger says (12:24 PM 12:24):
tom, have a word with the TA3d people, would ya
I got an email from dreamhost saying their section of the hosting is spewing out random temp files
If its enough for dreamhost to intervene I would seriously look into it.

Disabling the problem should be a higher priority than fixing it while its running. Incurring the wrath of our webhost having prepaid 3 years is not a good idea.

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Tue Jul 01, 2008 3:43 pm

hm, strange, maybe it's the websvn cache, it looks huge. If it's not this I don't see what it could be, we don't create temporary files elsewhere.
=>;-D Penguin Powered

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Tue Jul 01, 2008 4:08 pm

I don't know why but I can't delete any file :( . I tried to clean the cache (~22000 files) and the temp dir but it just "freezes" doing nothing.
=>;-D Penguin Powered

milipili
Posts: 545
Joined: Thu Nov 02, 2006 8:52 am
Location: Paris (France)
Contact:

Post by milipili » Tue Jul 01, 2008 4:19 pm

hum I wanted the same websvn but if it generates so much files I think I will keep using a trac for my own projects :)
Damien Gerard
Ta3d & Yuni Developer

Doors
Posts: 114
Joined: Wed Jan 09, 2008 7:53 pm
Contact:

Post by Doors » Wed Jul 02, 2008 5:35 am

[quote="zuzuf"]I don't know why but I can't delete any file :( . I tried to clean the cache (~22000 files) and the temp dir but it just "freezes" doing nothing.[/quote]

I also use Dreamhost (Loe the storage, love the bandwidth, I finally hit 1% last month after a couple of years) and have occasionally had files in the FTP that I could do nothing with. What I wound up doing was using the webftp interface in stead of an ftp client like filezilla, it seems to do better with funky files.
Don't just look at the future through a window.
Open a door and go there.
http://ta3d.freedoors.org
http://www.freedoors.org
http://baencd.freedoors.org

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Wed Jul 02, 2008 2:14 pm

I'll try that this week end then, from university I can only use ssh from an account on a proxy server :cry:
=>;-D Penguin Powered

milipili
Posts: 545
Joined: Thu Nov 02, 2006 8:52 am
Location: Paris (France)
Contact:

Post by milipili » Wed Jul 02, 2008 2:54 pm

SSH is all you need :D
Damien Gerard
Ta3d & Yuni Developer

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Wed Jul 02, 2008 3:28 pm

yes, but it doesn't want to remove files :cry: , at least it's slow :( . I am trying again in verbose mode ... it removes around a file or two per second and there are around 22000 files
=>;-D Penguin Powered

milipili
Posts: 545
Joined: Thu Nov 02, 2006 8:52 am
Location: Paris (France)
Contact:

Post by milipili » Wed Jul 02, 2008 4:02 pm

What is the filesystem ?
With so much files it may take some time to remove and to reindex the b-tree (or something else)
Last edited by milipili on Wed Jul 02, 2008 4:08 pm, edited 1 time in total.
Damien Gerard
Ta3d & Yuni Developer

milipili
Posts: 545
Joined: Thu Nov 02, 2006 8:52 am
Location: Paris (France)
Contact:

Post by milipili » Wed Jul 02, 2008 4:05 pm

Anyway ...

Code: Select all

$ screen
> rm -rf ./thefolder
ctrl + d
And tomorrow morning :

Code: Select all

screen -r
:D

You may try "find . -exec rm -vf '{}' \;" if you can not do `rm *`
Last edited by milipili on Wed Jul 02, 2008 4:11 pm, edited 1 time in total.
Damien Gerard
Ta3d & Yuni Developer

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Wed Jul 02, 2008 4:10 pm

it's exactly what I've done :) . Now websvn cache is empty but it's still cleaning the temp directory (still from websvn) which contains lots of files too :shock:
=>;-D Penguin Powered

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Wed Jul 02, 2008 5:19 pm

both cache and temp dirs from websvn are cleared :wink:
=>;-D Penguin Powered

milipili
Posts: 545
Joined: Thu Nov 02, 2006 8:52 am
Location: Paris (France)
Contact:

Post by milipili » Wed Jul 02, 2008 5:20 pm

Just to be sure... did you make an alias to mktemp ? :D
Damien Gerard
Ta3d & Yuni Developer

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Wed Jul 02, 2008 5:23 pm

I didn't create any alias there
=>;-D Penguin Powered

User avatar
AF
Administrateur - Site Admin
Posts: 139
Joined: Thu Dec 28, 2006 8:19 pm
Location: NW UK
Contact:

Post by AF » Wed Jul 02, 2008 6:32 pm

From: DreamHost Customer Support Team <support@dreamhost.com>
Date: 2008/6/29
Subject: [chrbar12 18910558] Message from support.
To: BlackLiger788@gmail.com


------------------------------------------------------------------------
- After reading this response, please consider visiting
- the URL below to comment on its quality. Thanks!
-
- http://www.dreamhost.com/survey.cgi?n=1 ... &m=3313501
------------------------------------------------------------------------

Hello,


I was doing some maintenance on your server, Bart, and noticed that your
ta3d user had quite a bit of data stored in the /tmp directory
(approximately 3 GB). This was stored in folders with random names like:


/tmp/wsvn2JITbm

/tmp/wsvn4JLC7t


I have removed these directories to prevent any service outages on the
server (the disk space for /tmp was nearly completely full). Please
carefully review any scripts or sites that are run under the ta3d user to
make sure that any data written to the /tmp directory is responsibly
maintained.


If you have any questions, please feel free to ask. :)


Thanks!

Craig


--

DreamHost Support Team + support@dreamhost.com

Earn over $97 for each referral: http://www.dreamhost.com/rewards.html

To continue this support case, just reply to this email.

Open a new case at: https://panel.dreamhost.com/?tab=support
As a side note /tmp has a maximum size of 3.5GB

milipili
Posts: 545
Joined: Thu Nov 02, 2006 8:52 am
Location: Paris (France)
Contact:

Post by milipili » Thu Jul 03, 2008 9:39 am

Is it possible to weekly/daily clean the websvn cache with a

Code: Select all

find /tmp/where_websvn_is  '(' -type f -and -atime +10 ')' -exec rm -f '{}' \;
or something else ?
Damien Gerard
Ta3d & Yuni Developer

jpic
Posts: 1
Joined: Tue Sep 16, 2008 5:50 pm

Post by jpic » Tue Sep 16, 2008 5:57 pm

Hi, i can set up Trac on my server for your own development for free, as well as setting up a mailing list if you need or other stuff like that.

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Tue Sep 16, 2008 6:09 pm

Hi,

that's interesting, it looks like it's the moment to look at what we need :)
currently we have:
_a website
_a Trac
_a subversion repository
_an apt repository
_an urpmi repository
(what about a mod repository ?)

having a mailing list would be great, we could change current support email to a mailing list, it would be easier.
=>;-D Penguin Powered

milipili
Posts: 545
Joined: Thu Nov 02, 2006 8:52 am
Location: Paris (France)
Contact:

Post by milipili » Thu Sep 25, 2008 7:54 am

I am currently upgrading my servers zuzuf (where the trac is hosted) and the disk space won't be a problem in the future. If you want another webhost or a ML just ask it is not a hard task (for the ML it depends how you want it - <something>@ta3d.org will be great)
Damien Gerard
Ta3d & Yuni Developer

milipili
Posts: 545
Joined: Thu Nov 02, 2006 8:52 am
Location: Paris (France)
Contact:

Post by milipili » Thu Sep 25, 2008 7:56 am

And a ML would be far better than a forum which is hard to follow :)
Damien Gerard
Ta3d & Yuni Developer

User avatar
zuzuf
Administrateur - Site Admin
Posts: 3281
Joined: Mon Oct 30, 2006 8:49 pm
Location: Toulouse, France
Contact:

Post by zuzuf » Thu Sep 25, 2008 5:10 pm

Yes the forums start being used by much more people than just the dev team :). I like the idea of a <something>@ta3d.org :), let's start with:
dev@ta3d.org - for developers only
community@ta3d.org - self explanatory :)
=>;-D Penguin Powered

Post Reply

Who is online

Users browsing this forum: No registered users and 5 guests