Skip to content

Added redundant MAP_KEY_VALUE annotation to parquet's thrift structure #3401

@HuaHuaY

Description

@HuaHuaY

Describe the bug, including details regarding any error messages, version, and platform.

Show in apache/arrow#49114 (comment).
list<map<string, string>> schema will generate this structure, and the MAP_KEY_VALUE annotation at middle level is not required in parquet's spec https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#maps.

  required group list_of_maps (LIST) {
    repeated group array (MAP) {
      repeated group key_value (MAP_KEY_VALUE) { // <-- here
        required binary key (STRING);
        required binary value (STRING);
      }
    }
  }

Component(s)

Thrift

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions