They cannot examine the box too closely at any point, but it can be shown empty and free of guile after the trick. The display is very clean.
Daniel Garcia talks about this a lot and when they pull the card out of the box, the question in their mind is "Is that my card?" To them the box is just a box, it is handled by them and it doesn't look suspicious.
If you are performing for family and friends you might have other issues. Strangers are more apt to respect your property. If you feel like whomever you are performing for will not respect the box then this is not the trick for you.
For professionals, who have more experience with audience control, I think that this effect has quite a lot to offer.