Okay, you have a point, skip the checklist item.
Speaking about reality, I doubt the passengers will silently wait to get in and just sit down quitly in front of the closed door ... and not even start to scream if the plane will start moving. I would assume they would knock on the door or walk around the plane to get some attention.
Not sure about you, but I definitely would do it.