I would like to create a custom collection that implements ICollection.
ICollection
But I would like not to expose some memebers of ICollection like
I would rather suggest you to consider "Composition" over "Inheritance" here.
That gives you more control over what all to expose to the outer world, with added advantage of dynamic binding with the actual collection.