Do _NOT_ drive the car or run the engine until you get this fixed. The balancer should not move under the conditions you describe. If the engine is run you will damage more parts and have more to fix.