The first known case of humans going to court over investment losses triggered by autonomous machines will test the limits of liability.