question:how to deal the file and segment after merge
A. i use carbon.compaction.level.threshold config and df.write api to write data ,it can merge the segments file in hdfs,but the origianl file does not delete,how can i delete them
B. In fact, i use StreamingWriter to write data,but it not support the string value over 32000char,i modify the org.apache.carbondata.streaming.parser.FieldConverter to make isVarcharFIle varible default true,it can insert,but when i use sql to query,it throw Exception,so i change to use df.write api;it make me crazy ,please help.
Re: question:how to deal the file and segment after merge
A: you can use command 'clean files for table table_name' to delete
B: stream table can not support long string now. What's the problem with
'df.write api', please give your code and error message.