Summary

motivation：

• Data EXPLORATION for NDJSON and CSV
• NDJSON By name misses the ability to treat a line as a variant

example

select $1,$2,$10 from @~/1.csv.gz;
----
$1	$2	$10
100	small	<null>
200	lamb co.	<null>

whole picture

MATCH_COLUMN_BY_NAME

MATCH_COLUMN_BY_NAME = CASE_SENSITIVE | CASE_INSENSITIVE | NONE

NONE means by pos

default value

• copy (without transform): based on file type:
  • Parquet/NDJson/XML: CASE_SENSITIVE
  • TSV/CSV: NONE
• Select: based on select type:
  • select $1, $2 ...: None
  • select id, age, ...: CASE_SENSITIVE
    • use settings:
      • unquoted_ident_case_sensitive: default 0
      • quoted_ident_case_sensitive: default 1
  • Select *
    • Only support parquet

Tasks

• support $1, $2

  add MATCH_COLUMN_BY_NAME
• by POS

  • select CSV
  • Copy/select NDJSON
  • Copy/select Parquet （optional）

  To pick up a draggable item, press the space bar. While dragging, use the arrow keys to move the item. Press space again to drop the item in its new position, or press escape to cancel.
• by NAME

  • Select JSON

  To pick up a draggable item, press the space bar. While dragging, use the arrow keys to move the item. Press space again to drop the item in its new position, or press escape to cancel.