Loadbalancer module remote port not working

[dtzar]

When you use the official azurerm loadbalancer with a remote port i.e.

"remote_port" {
    ssh = ["Tcp", "22"]
  }

This creates a NAT rule from 50001 --> 22 for SSH but this rule does not effectively enable SSH access to the VM (times out). When you look at the configuration in the portal, you can see that the rule is in place, but it doesn't have a target:

Unsure of whether this is a problem with the loadbalancer module, VMSS, or other - but just filing here.