We had one taken out as part of a larger job, and I can say (a) it's a big enough job that contractors will quote it for you even if you're not doing other work, (b) if you take out only part of it, it has to be starting from the top, not the bottom, and (c) chimney bricks are toxic waste and as such the longer you wait to do it, the more expensive it'll likely be.