There's no API for it, no. The proper way to do that, then, is to signal the current queue that it should stop, and spawn a new queue with the desired WorkerLimit in its place.
The documented way to stop a running queue is:
# Stop a running queue
$kernel->call( $queue_alias => 'stop' );