question:how to deal the file and segment after merge

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

question:how to deal the file and segment after merge

laughing_sheng@qq.com
A. i use carbon.compaction.level.threshold config and df.write api to write data ,it can merge the segments file in hdfs,but the origianl file does not delete,how can i delete them
B. In fact, i use StreamingWriter to write data,but it not support the string value over 32000char,i modify the org.apache.carbondata.streaming.parser.FieldConverter to make isVarcharFIle varible default true,it can insert,but when i use sql to query,it throw Exception,so i change to use df.write api;it make me crazy ,please help.
Reply | Threaded
Open this post in threaded view
|

Re: question:how to deal the file and segment after merge

xm_zzc
Hi:
A: you can use command 'clean files for table table_name' to delete
compacted segments;
B: stream table can not support long string now. What's the problem with
'df.write api', please give your code and error message.



--
Sent from: http://apache-carbondata-user-mailing-list.3231.n8.nabble.com/