Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implements Hive Input/Output format to use vineyard as the storage backend #1441

Closed
wants to merge 40 commits into from

Shard code.

1f17f00
Select commit
Loading
Failed to load commit list.
Closed

Implements Hive Input/Output format to use vineyard as the storage backend #1441

Shard code.
1f17f00
Select commit
Loading
Failed to load commit list.
Codacy Production / Codacy Static Code Analysis required action Aug 3, 2023 in 0s

21 new issues (0 max.) of at least minor severity.

Codacy Here is an overview of what got changed by this pull request:

Issues
======
- Added 21
           

Complexity increasing per file
==============================
- java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java  2
- java/hive/src/main/java/io/v6d/hive/ql/io/VineyardSplit.java  1
- java/hive/src/main/java/io/v6d/hive/ql/io/VineyardSerDe.java  7
- java/hive/src/main/java/io/v6d/hive/ql/io/VineyardOutputFormat.java  20
         

Complexity decreasing per file
==============================
+ java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/RecordBatchBuilder.java  -1
+ java/modules/basic/src/main/java/io/v6d/modules/basic/columnar/ColumnarDataBuilder.java  -3
+ java/modules/basic/src/main/java/io/v6d/modules/basic/columnar/ColumnarData.java  -3
+ java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/util/SchemaSerializer.java  -2
         

Clones added
============
- java/core/src/main/cpp/ffi/ffi.cc  4
- java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Int64ArrayBuilder.java  2
- java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/DoubleArrayBuilder.java  2
- java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/FloatArrayBuilder.java  2

See the complete overview on Codacy

Annotations

Check notice on line 46 in java/hive/src/main/java/io/v6d/hive/ql/io/VineyardOutputFormat.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/hive/src/main/java/io/v6d/hive/ql/io/VineyardOutputFormat.java#L46 

Unused import - org.apache.hadoop.hive.serde2.typeinfo.DecimalTypeInfo.

Check notice on line 10 in java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java#L10 

Unused import - org.apache.hadoop.hive.serde2.objectinspector.ObjectInspector.

Check notice on line 11 in java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java#L11 

Unused import - org.apache.hadoop.hive.serde2.objectinspector.StructField.

Check notice on line 12 in java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java#L12 

Unused import - org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.

Check notice on line 13 in java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java#L13 

Unused import - org.apache.hadoop.hive.serde2.typeinfo.StructTypeInfo.

Check notice on line 15 in java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java#L15 

Unused import - org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils.

Check notice on line 16 in java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/hive/src/main/java/io/v6d/hive/ql/io/VineyardRowWritable.java#L16 

Unused import - org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils.getStandardWritableObjectInspectorFromTypeInfo.

Check notice on line 25 in java/hive/src/main/java/io/v6d/hive/ql/io/VineyardSerDe.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/hive/src/main/java/io/v6d/hive/ql/io/VineyardSerDe.java#L25 

Unused import - org.apache.hadoop.hive.serde2.SerDeUtils.

Check notice on line 19 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java#L19 

Unused import - java.nio.ByteOrder.

Check notice on line 20 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java#L20 

Unused import - java.util.concurrent.atomic.AtomicInteger.

Check notice on line 30 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java#L30 

Unused import - io.netty.buffer.ByteBuf.

Check notice on line 31 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java#L31 

Unused import - io.netty.buffer.LargeBuffer.

Check notice on line 32 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java#L32 

Unused import - io.netty.buffer.PooledByteBufAllocatorL.

Check notice on line 33 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/Buffer.java#L33 

Unused import - io.netty.buffer.UnsafeDirectLittleEndian.

Check notice on line 26 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java#L26 

Unused import - io.netty.buffer.ByteBuf.

Check notice on line 27 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java#L27 

Unused import - io.netty.buffer.PooledByteBufAllocatorL.

Check notice on line 28 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java#L28 

Unused import - io.netty.buffer.UnsafeDirectLittleEndian.

Check notice on line 31 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java#L31 

Unused import - java.util.concurrent.atomic.AtomicInteger.

Check notice on line 33 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/BufferBuilder.java#L33 

Unused import - org.apache.arrow.memory.RootAllocator.

Check notice on line 24 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/StringArrayBuilder.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/StringArrayBuilder.java#L24 

Unused import - org.apache.arrow.vector.holders.VarCharHolder.

Check notice on line 23 in java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/util/SchemaSerializer.java

See this annotation in the file changed.

@codacy-production codacy-production / Codacy Static Code Analysis

java/modules/basic/src/main/java/io/v6d/modules/basic/arrow/util/SchemaSerializer.java#L23 

Unused import - org.apache.arrow.flatbuf.Message.
View more details on Codacy Production