Indices created with 7.13 cannot be opened with more recent versions when using index sorting on date_nanos #132040
Description
Indices created with 7.13 cannot be opened with more recent versions of Elasticsearch, when using index sorting on a date_nanos field.
Start Elasticsearch 7.13.x - ./elasticsearch-7.13.0/bin/elasticsearch -E path.data=/tmp/data -E xpack.security.enabled=false
PUT my-sorted-index
{
"settings": {
"index": {
"number_of_shards": 1,
"number_of_replicas": 0,
"sort.field": "@timestamp",
"sort.order": "desc"
}
},
"mappings": {
"properties": {
"@timestamp": {
"type": "date_nanos"
},
"message": {
"type": "text"
}
}
}
}
POST my-sorted-index/_doc
{
"@timestamp": "2025-07-28T15:00:00Z",
"message": "A simple timestamped log message 1."
}
Start Elasticsearch 7.14.x - ./elasticsearch-7.14.0/bin/elasticsearch -E path.data=/tmp/data -E xpack.security.enabled=false. AND elasticsearch-7.17.29
Caused by: java.lang.IllegalArgumentException: cannot change previous indexSort=<sortednumeric: "@timestamp">! missingValue=-9223372036854775808 selector=MAX type=LONG (from segment=_0(8.8.2):c1:[indexSort=<sortednumeric: "@timestamp">! missingValue=-9223372036854775808 selector=MAX type=LONG]:[diagnostics={java.vendor=AdoptOpenJDK, os=Mac OS X, java.version=16, java.vm.version=16+36, lucene.version=8.8.2, os.arch=x86_64, java.runtime.version=16+36, source=flush, os.version=10.16, timestamp=1753732390909}]:[attributes={Lucene87StoredFieldsFormat.mode=BEST_SPEED}] :id=cw83zw6yatfpx1z6ogelhi1zy) to new indexSort=<sortednumeric: "@timestamp">! missingValue=0 selector=MAX type=LONG
at org.apache.lucene.index.IndexWriter.validateIndexSort(IndexWriter.java:1136) ~[lucene-core-8.9.0.jar:8.9.0 05c8a6f0163fe4c330e93775e8e91f3ab66a3f80 - mayyasharipova - 2021-06-10 17:50:37]
at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1071) ~[lucene-core-8.9.0.jar:8.9.0 05c8a6f0163fe4c330e93775e8e91f3ab66a3f80 - mayyasharipova - 2021-06-10 17:50:37]
at org.elasticsearch.index.engine.InternalEngine.createWriter(InternalEngine.java:2289) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.index.engine.InternalEngine.createWriter(InternalEngine.java:2277) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.index.engine.InternalEngine.<init>(InternalEngine.java:239) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.index.engine.InternalEngine.<init>(InternalEngine.java:197) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.index.engine.InternalEngineFactory.newReadWriteEngine(InternalEngineFactory.java:14) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.index.shard.IndexShard.innerOpenEngineAndTranslog(IndexShard.java:1736) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.index.shard.IndexShard.openEngineAndRecoverFromTranslog(IndexShard.java:1702) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.index.shard.StoreRecovery.internalRecoverFromStore(StoreRecovery.java:421) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.index.shard.StoreRecovery.lambda$recoverFromStore$0(StoreRecovery.java:87) ~[elasticsearch-7.14.0.jar:7.14.0]
at org.elasticsearch.action.ActionListener.completeWith(ActionListener.java:434) ~[elasticsearch-7.14.0.jar:7.14.0]
... 8 more
relates #74760