I think by being quiet you might be not doing justice to your role.
If the situation demands for you to speak up or express your expertise on a topic when you see others being swayed in a wrong direction, you need to do so.
Not speaking up because you think its wrong to be the loudest in the room is simply avoiding conflict.
If you need to be loud to make yourself heard, do so.