Laravel DB Insert Error: Allowed Memory Size Exhausted

Question

I'm running into an issue when trying to insert ~20K records into my DB. I notice that even though I'm echoing inside my foreach loop, I'm not getting anything outputted in the command line. Instead, I get an error after inserting ~9440 records relating to...

Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 91 bytes) in /Users/me/Sites/Laravel/database/connection.php on line 293

Here is my code (tried using both Eloquent and Fluent):

<?php

class Process_Controller extends Base_Controller
{
    public function action_migrate()
    {
        $properties = DB::table('raw_properties')->get('id');
        $total = count($properties);

        foreach ($properties as $x => $p) {
            $r = RawProperty::find($p->id);
            $count = $x + 1;

            $prop_details = array(
                'column' => $r->field,
                // Total of 21 fields
            );

            DB::table('properties')->insert($prop_details);

            echo "Created #$count of $total\n";
        }
    }
}

Community · Accepted Answer · 2017-05-23 12:32:21Z

34

The accepted answer is fixing the symptom rather then the problem. The problem is the Laravel query log (in memory) is eating all your RAM when you execute such a large # of queries. See the answer here: https://stackoverflow.com/a/18776710/221745

Or, in brief, turn off query logging via:

DB::disableQueryLog()

Before executing 20k queries

edited May 23, 2017 at 12:32

CommunityBot

11 silver badge

answered Sep 23, 2013 at 17:53

Erik

20.7k8 gold badges47 silver badges77 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Antonio Carlos Ribeiro Over a year ago

I agree. While inserting 1M lines in a table 2G wasn't enough, but DB::disableQueryLog() fixed it for me.

malhal Over a year ago

thanks I'd def prefer to fix the problem rather than the symptom

Ruben Arevalo Over a year ago

Does this have to be enabled again to have Querylogging or is this for the current script?

François Breton Over a year ago

In laravel 5 its disabled by default. So if you have memory problem you must do the opposite to inspect generated queries : DB::enableQueryLog(); [...] dd(DB::getQueryLog()); stackoverflow.com/a/27753889/2152973

Rubin Porwal · Accepted Answer · 2012-09-16 00:59:10Z

0

This error depicts that your PHP script has exhausted memory limit due to insufficient memory allocated for script.

You need to increase memory_limit using the ini_set function e.g ini_set('memory_limit','128M');

answered Sep 16, 2012 at 0:59

Rubin Porwal

3,8451 gold badge27 silver badges27 bronze badges

1 Comment

th3hamburgler Over a year ago

I just hit this problem to, increasing the memory limit is a quick fix. A much better solution is to turn off query logging as recommended by @Erik below

Richard Dev · Accepted Answer · 2022-06-12 23:55:41Z

0

I did the DB::disableQueryLog() and continued to get the error. I ended up Pausing Telescope from recording the queries. You can do this from the telescope web interface > queries > Click the Pause Icon.

answered Jun 12, 2022 at 23:55

Richard Dev

1,1908 silver badges21 bronze badges

Collectives™ on Stack Overflow

Laravel DB Insert Error: Allowed Memory Size Exhausted

3 Answers 3

4 Comments

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

4 Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related