When I ran exact_extract(rasterlayer, sf_object) I was getting the following error:
in CPP_exact_extract(x, weights, wkb, default_value, default_weight, : Unsupported geometry type.
I wasn't sure what was going on, since my other extracts with nearly identical sf objects worked. I figured it out, so documenting my answer here.