Are all lubricants safe to swallow?

I know there are lubricants that are specifically edible and flavored, but what about others like silicone lubes? Are they dangerous if ingested during oral sex?