After way too much sanity checking, I convinced myself that one should indeed plow ahead despite the positive-definiteness alarms. However in order to get CGAL not to abort, you have to #define CGAL_QP_NO_ASSERTIONS before including the headers!
Not sure how one would get the same behavior in R.
CGAL seems pretty slick, btw.