Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spark4.0.0preview2 #1275

Open
wants to merge 185 commits into
base: Spark4.0preview1
Choose a base branch
from
Open

Spark4.0.0preview2 #1275

wants to merge 185 commits into from

Conversation

ghislainfourny
Copy link
Member

No description provided.

dloughlin added 30 commits May 28, 2023 16:53
Create tests for delta-file function
179dfbc
Create tests for delta-file function with transform
d049873
Implement delta-file function
d5f8f00
Add delta as output option
95d135f
Add delta as output option
85c7342
Add delta to configs
75d6c3f
Create test data for delta
e907de3
Create test to check non-delta-file values and non copied values are …
29177c5 
…immutable
Create error for attempt to modify immutable values
a6e9503
Make default mutability level -1
38c01f2
Adjust error semantics to check for mutability level of -1
a17d345
Adjust test to new immutable modify error semantics
c083e9a
Add delta file to alter
24cdb58
Create tests for semantics of updating delta files directly
32e5e01
Add mutabilityLevel getters and setters to itemType hierarchy
27281a6
Implement setting of mutabilityLevel for dataframes with itemtypes
f95d301
Apple spotless
9f5b847
Remove err debug
85fd7d3
Remove json keyword from updating exprs
0434570
Fix copy classnotfound exception when using repl
ca0bdd5
Add this. to solve unqualified acceses
0fb6e57
Add updating functions lexing
72ae3a2
Update functiondecl visit to incorporate isUpdating and isExternal bo…
3eb57d7 
…oleans
Update FunctionSignature to include isUpdating flag for StaticContext…
cc5112c 
…Visitor
Implement ExpressionClassificationVisitor visits for InlineFunctions …
681d30c 
…and FunctionCalls along with the errors
Create simple tests for updating functions
dcdfe63
Extend function iterators to account for updating functions and imple…
772727c 
…ment getPUL methods
Reorganise visitor list to ensure function calls are set to updating …
7a0ebd9 
…before type inference
Make isUpdating non transient to ensure it retains after deppCopy
6d10219
Include isUpdating to function signatures in InferTypeVisitor
9f80e1d
David-C-L and others added 30 commits September 18, 2024 21:11
@David-C-L
extend SequenceOfItems with functions to apply PUL and determine if m…
24ffb46 
…aterialisation is possible
@David-C-L
add command line arg for updates and adjust execution flow
0da26c1
@David-C-L
adjust tests containing update tests with cli parameter and SeqOfItem…
7912579 
…s api
@David-C-L
add isSequential and isUpdating methods to program and StatementsWith…
ea53993 
…OptionalExpr iterators
@David-C-L
allow treat exprs to be updating
b02e732
@ghislainfourny
Merge pull request #1260 from David-C-L/deltalake-scripting-updates
7ee88c3 
Deltalake scripting updates
@David-C-L
run mvn spotless
4fc8cc6
@ghislainfourny
Merge pull request #1261 from David-C-L/deltalake-scripting-updates
3520ad7 
Delta Lake/Scripting changes: run mvn spotless
@ghislainfourny
Merge pull request #1256 from RumbleDB/deltalake
ae77e46 
Deltalake
@David-C-L
create function iterators for create and delete delta table funcs
8821cf2
@David-C-L
add functions to built in catalogue
2dd4a40
@David-C-L
create tests for new delta lake funcs
62e4f14
@David-C-L
run mvn spotless:apply
cd9cf10
@ghislainfourny
Merge pull request #1267 from David-C-L/delta-lake-functions
6901018 
Delta lake functions
@ghislainfourny
Update install.md
0e78311
@ghislainfourny
Update Getting started.md
c1bd37e
@ghislainfourny
Merge branch 'master' into delta-lake-functions
d8dac1f
@ghislainfourny
Merge pull request #1268 from RumbleDB/delta-lake-functions
90a7faa 
Delta lake functions
Remove execution mode warning.
abd0770
Move to preview2.
bd0d237
@ghislainfourny
Merge pull request #1273 from RumbleDB/ExecutionModeWarning
1f52989 
Remove execution mode warning.
Merge master.
295bb11
Require Java 11.
d06f0e6
Require 11 or 17.
dc061de
Fix compile error.
31bb3f7
@ghislainfourny
Merge pull request #1274 from RumbleDB/Java11
771cc06 
Require Java 11 or 17
@ghislainfourny
Merge branch 'master' into Spark4.0.0
d9c3d5a
Update delta version.
50bc144
Merge branch 'Spark4.0.0' of github.com:RumbleDB/rumble into Spark4.0.0
361a07a
Fix delta module.
b202da7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ghislainfourny @David-C-L