Box cutters are the wrong thing for this. You need a more flexible blade - one of those razor blade holders might do better since there's a bit more flex on it. It's still lots of scraping, but it makes it easy to get the little flecks off. You might also try using some solvents on it (goof off or something like that) rubbed on it and then cleaned up with the razor.