[pipelining] Add guards for non-float tensors when building pipeline …