imx-bus: Fix defered probing when passive parent device isn't ready yet

2 jobs for ondemand in 48 minutes and 19 seconds (queued for 1 second)
latest
Status Job ID Name Coverage
  Build
passed #270148
librem5
build:aarch64

00:14:39

passed #270149
librem5:arm64
build:deb

00:48:19