UIImage to CVPixelBuffer memory issue

Question

I have a swift function that takes an UIImage and returns a CVPixelBuffer. When running this function multiple times, the memory keeps growing, leading to a crash.

What I already figured out:

With instruments I isolated the memory problem in the image.draw line of code. It shows a lot of CGImage data kept in memory over the time.
I isolated the function, so I'm sure that the problem is not in something that happen outside of it (in the caller), cause I removed all the code from there and the memory keeps growing.
I tried dispatching the calls to this method, with some delay, to give time to the system to deallocate, but it's not working
I tried wrapping multiple part of the code in autoreleasepool, still not working.
I tried on the main thread, on utility.qos thread, etc, nothing changes
I read every other question on StackOverflow, but looks like other people solutions aren't working in my case.

This is my code. Any help is appreciated, since I'm really banging my head on this one.

fileprivate func CreatePixelBufferFromImage(_ image: UIImage) -> CVPixelBuffer?{

    let size = image.size;

    var pxbuffer : CVPixelBuffer?

    let status = CVPixelBufferPoolCreatePixelBuffer(kCFAllocatorDefault, self.exportingAdaptor!.pixelBufferPool!, &pxbuffer)

    guard (status == kCVReturnSuccess) else{
        return nil
    }

    CVPixelBufferLockBaseAddress(pxbuffer!, CVPixelBufferLockFlags(rawValue: 0));
    let pxdata = CVPixelBufferGetBaseAddress(pxbuffer!);

    let rgbColorSpace = CGColorSpaceCreateDeviceRGB();
    let context = CGContext(data: pxdata, width: Int(size.width),
                            height: Int(size.height), bitsPerComponent: 8, bytesPerRow: CVPixelBufferGetBytesPerRow(pxbuffer!), space: rgbColorSpace,
                            bitmapInfo: CGImageAlphaInfo.premultipliedFirst.rawValue);

    context?.translateBy(x: 0, y: image.size.height);
    context?.scaleBy(x: 1.0, y: -1.0);

    UIGraphicsPushContext(context!)
    image.draw(in: CGRect(x: 0, y: 0, width: size.width, height: size.height));
    //
    UIGraphicsPopContext()
    CVPixelBufferUnlockBaseAddress(pxbuffer!, CVPixelBufferLockFlags(rawValue: 0));

    return pxbuffer
}

Could you post standalone code? What is for example exportingAdaptor? — Vyachaslav Gerchicov
– Vyachaslav Gerchicov, Commented Jan 29, 2020 at 12:20

Vadim Kotov · Accepted Answer · 2017-10-17 12:11:34Z

5

I found out that the problem was not the pixelbuffer, but the image reference.
It looks like (it's just my opinion based on the behaviour here) when I draw the image in the context, a lot of image pixel data gets stored in the image.cgimage object. So I solved by releasing my reference to the image I just draw after every call to this function, and the memory remained stable for all the process.

edited Oct 17, 2017 at 12:11

Vadim Kotov

8,2848 gold badges51 silver badges63 bronze badges

answered May 28, 2017 at 2:36

Axy

3843 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Asteroid Over a year ago

I know this question is old, but I think I am facing the same problem. How did you exactly solve this? How did you release the reference to the image?

MoDJ · Accepted Answer · 2017-05-26 03:22:13Z

0

You need to drop the reference you created or the pixel buffer will remain held and then a new one gets created on each call. Dropping the ref to the pixel buffer puts it back into the pool so that it can be used on the next call.

answered May 26, 2017 at 3:22

MoDJ

4,4692 gold badges33 silver badges71 bronze badges

1 Comment

Axy Over a year ago

Tried like this: var buffer = self.CreatePixelBufferFromImage(image); buffer = nil; It's still not working. Memory goes up

Collectives™ on Stack Overflow

UIImage to CVPixelBuffer memory issue

2 Answers 2

1 Comment

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related