PHP Out of Memory - Crashes Apache?

Question

I am running PHP version 5.3.0 and Apache: 2.2.11

When I run PHP scripts that consume a lot of memory (I think) - large loops etc. My Apache web server reports a crash?!

[Sat Jan 02 00:51:30 2010] [notice] Parent: child process exited with status 255 -- Restarting.

Do I need to increase memory somewhere? I currently have memory set to

memory_limit = 512M

PHP hasn't complained about this so I am thinking its something else?

Thanks all

Update

This error has been logged by my windows machine in the event viewer:

Faulting application httpd.exe, version 2.2.11.0, time stamp 0x493f5d44, faulting module php5ts.dll, version 5.3.0.0, time stamp 0x4a4922e7, exception code 0xc0000005, fault offset 0x00083655, process id 0x1588, application start time 0x01ca8b46e4925f90.

Update 2

Script in question. I've removed the URL.

<?php error_reporting(E_ALL);

set_time_limit(300000);

echo 'start<br>';

include_once('simple_html_dom.php');

$FileHandle = fopen('tech-statistics3.csv', 'a+') or die("can't open file");

for($i =1; $i < 101; $i ++){
 // Create DOM from URL
 $html = file_get_html("http://www.x.com/$i");

 foreach($html->find('div[class=excerpt]') as $article) {

  $item0 = $article->children(1)->children(1)->children[0]->plaintext;

  $item1 = $article->children(1)->children(1)->children[0]->plaintext;

  $item2 = $article->children(1)->children(0)->children(0)->children(0)->plaintext;

  //$item3 = $article->children(1)->children(0)->children(0)->children[1]->children(0)->next_sibling();

  $stringa = trim($item0).",".trim($item1).",".trim($item2)."\r\n";

  fwrite($FileHandle, $stringa);

  echo $stringa.'<br>';
  echo '------------>'.$i;
 }
}

fclose($FileHandle);

echo '<b>End<br>';

?>

Update 3

I am using the PHP Simple HTML DOM Parser and I have just found this:

http://simplehtmldom.sourceforge.net/manual_faq.htm#memory_leak

I think I should be clearing memory otherwise it will crash. Testing now.

Update4

Yep, it was a memory leak! :)

What operating system? Are you noticing a problem with your PHP scripts, or just noticing the error in the log file? — Seth
– Seth, Commented Jan 2, 2010 at 1:01
I am on Windows Vista at the moment and I am currently looking at the script and its over 220,000K for the httpd.exe process and it just got killed. — Abs
– Abs, Commented Jan 2, 2010 at 1:06
What's the source of your php.exe? Is it from windows.php.net/download or maybe xampp or ...? Is this your development/test/personal/fun machine where you can install (almost) anything you like? — VolkerK
– VolkerK, Commented Jan 2, 2010 at 1:21
This is wampserver (WAMP5) - my fun box! :) I thought I solved this problem before and I fixed another script before by making sure it was compatible with PHP 5.3 but its back again and its worrying! — Abs
– Abs, Commented Jan 2, 2010 at 1:37

Abs · Accepted Answer · 2010-01-05 21:17:08Z

2

Apache was crashing due to a memory leak which was caused by not closing a resource that was being used again and again in a for loop, as well as the script making use of recursion.

Thanks all for the help.

answered Jan 5, 2010 at 21:17

Abs

58.2k104 gold badges282 silver badges419 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

sohel14_cse_ju Over a year ago

@Abc..can you give an example how you mange this?I mean releasing resources after use in a iteration?

olimortimer Over a year ago

@sohel14_cse_ju hopefully my answer might help - stackoverflow.com/a/15946851/1426354

Joseph Lust · Accepted Answer · 2012-06-10 18:55:42Z

2

I ran into this today when parsing a ton of HTML in a loop. Here is the simple fix:

$dom = file_get_html("http://www.x.com/$i");
... // parse your DOM
$dom->clear() // clear before next iteration

Just calling the clear() method on the dom object when I was done in each iteration cleared it up for me.

answered Jun 10, 2012 at 18:55

Joseph Lust

20.1k8 gold badges91 silver badges86 bronze badges

3 Comments

Ahmad Alfy Over a year ago

I cannot find clear() in the DOMDocument's methods on php.net/manual/en/class.domdocument.php . Or I assume this is not about DOMDocument ?

Joseph Lust Over a year ago

Best luck with that documentation. It is abysmal, so don't read too deeply into it.

olimortimer Over a year ago

@AhmadAlfy I think it's the Simple HTML DOM clear() function that you want to be looking for, although that still isn't perfect - see stackoverflow.com/a/15946851/1426354

olimortimer · Accepted Answer · 2013-04-11 10:50:42Z

A bit late to the party, but I've been running into the same issue with a Segmentation Fault when using Simple HTML DOM. I'm making sure I'm using $html->clear(); and unset($html); to clear down the HTML I've loaded in, but I was still receiving the Segmentation Fault error during a large scrape of data.

I found that I needed to comment out some clear code in the simple_html_dom.php file. Look for function clear() within the simple_html_dom_node class, and comment out everything inside;

    function clear() {
            // These were causing a segmentation fault...
            // $this->dom = null;
            // $this->nodes = null;
            // $this->parent = null;
            // $this->children = null;
    }

davidtbernal · Accepted Answer · 2010-01-02 01:20:34Z

1

I've run into problems like these using PHP with Apache on Windows. Rather than reporting any useful information to the screen, the process simply dies. If at all possible, I would suggest running your code on a linux box with Apache & PHP. In my experience, that combination will generally report this as a memory error, whereas on Windows, nothing seems to happen at all. I've only seen this happen with recursion by the way.

answered Jan 2, 2010 at 1:20

davidtbernal

13.8k9 gold badges47 silver badges62 bronze badges

2 Comments

VolkerK Over a year ago

exception code 0xc0000005 means "Access violation" which tells you as much or as little as "Segmentation fault" on a linux machine ;-)

davidtbernal Over a year ago

Right, my point was that on a linux machine, PHP would catch the error, rather than just dying a fiery death. Anyway, it looks like they solved the problem.

Rob · Accepted Answer · 2010-01-02 01:01:07Z

0

You're not using recursion? I've seen PHP bug out and kill the Apache child without any useful logging output when infinite recursion occurs.

answered Jan 2, 2010 at 1:01

Rob

48.5k5 gold badges76 silver badges93 bronze badges

2 Comments

Mike Over a year ago

It's likely that recursion would actually increase the amount of memory consumed, since a stack frame would need to be stored for each call(it doesn't look like PHP supports tail recursion).

Abs Over a year ago

I am using recursion and a lot of stuff is being held in memory. This script will be on some good hardware, I am wondering what I should increase temporarily to get the script to finish?

Collectives™ on Stack Overflow

PHP Out of Memory - Crashes Apache?

Update

Update 2

Update 3

Update4

5 Answers 5

2 Comments

3 Comments

Comments

2 Comments

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

Update

Update 2

Update 3

Update4

5 Answers 5

2 Comments

3 Comments

Comments

2 Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related