Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert raw history change #7309

Closed
wants to merge 160 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
160 commits
Select commit Hold shift + click to select a range
5462f8a
Refactor: remove cluster.yaml config (#7102)
alexshtin Jan 17, 2025
e2daba8
Bump Nexus SDK v0.1.1 (#7116)
pdoerner Jan 17, 2025
c9a7813
Move namespace replication to own package (#7112)
stephanos Jan 17, 2025
ee654a1
Move namespace attr validator to own package (#7114)
stephanos Jan 18, 2025
f0e5891
Generic hooks for testing (#6938)
dnr Jan 18, 2025
7551f3c
use UnsetVersioningOverride field in ApplyWorkflowExecutionOptionsUpd…
carlydf Jan 18, 2025
e7719d2
Initial support for filtering workflows (#7072)
ychebotarev Jan 18, 2025
0a910af
Remove PhysicalTaskQueueManager from Engine (#7075)
stephanos Jan 21, 2025
1125103
Move tasktoken serializer to package (#7109)
stephanos Jan 21, 2025
2cbee2c
reserve delete_on_completion (#7036)
justinp-tt Jan 21, 2025
f9481a5
Add HSM Deletion Tombstone Tracking (#7014)
justinp-tt Jan 21, 2025
417562c
Nexus: Delete state machine on terminal state -- Part 3 (#6984) (#7128)
justinp-tt Jan 21, 2025
767cc29
OTEL in task processing (#7103)
stephanos Jan 21, 2025
b8b3cda
Do not send backfill task when event is empty (#7130)
xwduan Jan 22, 2025
729ee91
Fix flakey TestWorkflowNexusCallbacks_CarriedOver/WorkflowFailureRetr…
pdoerner Jan 22, 2025
bd3f204
Only trigger Docker builds if explicitly enabled in repository config…
swgillespie Jan 22, 2025
e243082
Embed Unimplemented*ServiceServer instead of Unsafe*ServiceServer (#7…
alexshtin Jan 22, 2025
72df948
OTEL noop vars (#7135)
stephanos Jan 22, 2025
26dbd25
Add target cluster to error messaging when verify replication tasks f…
laniehei Jan 22, 2025
ff3e7c8
Retry tests with previous attempt args if more than 10 tests fail (#7…
bergundy Jan 22, 2025
71e93a1
Remove read workflow API during namespace handover (#7140)
yux0 Jan 23, 2025
98f22bd
Unify OTEL resource names (#7131)
stephanos Jan 23, 2025
fb8393c
Fix flaky TestTransitionFromActivity (#7132)
ShahabT Jan 23, 2025
1940626
fix flaky xdc test TestCronWorkflowCompleteAndFailover (#7139)
hai719 Jan 23, 2025
e196abb
Move taskTracker and circularTaskBuffer to new file (#7147)
dnr Jan 23, 2025
03683d3
Remove MatchingLoadUserData config (#7148)
dnr Jan 23, 2025
cb4ed09
Include namespace name in NamespaceAlradyExists error message (#7156)
bergundy Jan 24, 2025
0d87f75
update old deployment component (#7150)
Shivs11 Jan 24, 2025
d7d8dd2
Remove persistence from namespace package (#7155)
stephanos Jan 24, 2025
eea4376
Use namespace.ID in dynamicconfig (#7160)
stephanos Jan 24, 2025
0682c47
Remove utf8validator and protolegacy build tag (#7146)
dnr Jan 24, 2025
a2e736c
Consolidate migration folder in OSS (NEW) (#7100)
zigeH Jan 24, 2025
087f4df
Handle nil TestHooks (#7161)
dnr Jan 24, 2025
536b556
Fix ErrStateMachineNotFound handling in HSM state replication (#7032)
justinp-tt Jan 24, 2025
8b5cd4d
[Reset] Add AllowChildReconnect flag in task generator (#7157)
gow Jan 25, 2025
39204ce
Deprecate Worker Versioning 2 (Rule Based Versioning) readme (#7162)
carlydf Jan 25, 2025
e5edee6
Report timed out tests (#7144)
stephanos Jan 27, 2025
4a6f0e2
[Scheduled Actions V2] Tweaks to the test helpers and default configs…
lina-temporal Jan 27, 2025
f5c1ad9
Refactor workflow id dedup, add callbacks to ms and update versioning…
rodrigozhou Jan 27, 2025
68c31b4
Workflow Update: check registryClearedErr in a proper place (#7145)
alexshtin Jan 27, 2025
4bb5867
Chasm Interface (#6987)
yycptt Jan 28, 2025
519fb71
Refactor: remove unneeded fields from FunctionalTestBase (#7170)
alexshtin Jan 28, 2025
c0a7f99
OTEL annotates gRPC responses (#7165)
stephanos Jan 28, 2025
71ef8e4
Refactoring: remove code duplication in query parsers (#7168)
ychebotarev Jan 28, 2025
e82422a
Actually delete HSMs on Nexus completion (#7171)
bergundy Jan 29, 2025
b01f22f
add gauge metrics for gc count and pause (#7176)
alfred-landrum Jan 29, 2025
a5b5b9f
Include task payload in OTEL debug (#7174)
stephanos Jan 29, 2025
e89fd19
Fix test TestProcessWorkflowRunTimeout_Pending (#7181)
rodrigozhou Jan 30, 2025
3d42e7e
Add batch activity unpause. Single activity commulative changes (#7169)
ychebotarev Jan 30, 2025
6546a31
Upgrade ringpop-go to fix locking bug (#7191)
dnr Jan 30, 2025
cccd932
Add history.alignMembershipChange setting (#6510)
dnr Jan 30, 2025
7d2da81
Don't return BUSY_WORKFLOW on polls (#7197)
dnr Jan 31, 2025
32df386
OTEL add grpc headers (#7192)
stephanos Jan 31, 2025
9fe70b4
Omit empty persistence fields in JSON (#7188)
stephanos Jan 31, 2025
3dd9794
Reduce logging on WFTCompletedHandler.Invoke error (#7195)
alexshtin Jan 31, 2025
5bd8857
Control state-based deletion using the enableTransitionHistory dynami…
justinp-tt Jan 31, 2025
feb0785
Basic CHASM registry implementation (#7184)
alexshtin Jan 31, 2025
5ad297b
CHASM: Fix default sharding function (#7214)
alexshtin Feb 1, 2025
458bbe2
Quick fix to reconfig maximumHandoverTimeoutSeconds (#7216)
zigeH Feb 2, 2025
020195d
Reduce default namespace cache refresh interval to 2s (#7209)
pdoerner Feb 3, 2025
01a9c41
Delete Namespace: read cache refresh interval from DC (#7215)
alexshtin Feb 3, 2025
72c6218
Add OnConflictOptions to StartWorkflowExecution (#7080)
rodrigozhou Feb 3, 2025
89a28e4
Add workflow status tag to query workflow metrics (#7226)
yiminc Feb 4, 2025
3ded01b
Update dependencies (#7213)
yiminc Feb 4, 2025
83d4abe
Update DescribeHistoryHost to check shard ownership (#7207)
yux0 Feb 4, 2025
1b8fa46
Remove pinned dependencies (#7232)
yiminc Feb 4, 2025
e4cfc5a
Send raw history blobs from history service to frontend (#7179)
prathyushpv Feb 4, 2025
f965375
Proto definition for CHASM nodes (#7223)
yycptt Feb 4, 2025
3dff733
Activity API: functional tests for batch activity unpause (#7193)
ychebotarev Feb 4, 2025
44799e7
Nexus error reyhdration pt2 (#7231)
bergundy Feb 4, 2025
4fdcb2b
CHASM: Rename name to type (#7225)
yycptt Feb 4, 2025
8de299c
[Reset] Add children_initialized_post_reset_point to WorkflowExecutio…
gow Feb 5, 2025
1b11ed2
[Reset] Track child workflows initiated after reset (#7210)
gow Feb 5, 2025
de8f006
Update Registry suggest CAN refactor (#7230)
stephanos Feb 5, 2025
74e715a
Dynamic config subscriber in Update Registry (#7224)
stephanos Feb 5, 2025
cf81c5b
OTEL omit redundant persistence blobs (#7212)
stephanos Feb 5, 2025
e806987
Upgrade to Nexus SDK 0.2.0 (#7241)
bergundy Feb 5, 2025
0412c86
OTEL persistence context deadline (#7208)
stephanos Feb 5, 2025
3bf03e2
Remove Subscription from Update Registry (#7251)
stephanos Feb 5, 2025
71a10ee
[Scheduled Actions] bump scheduler version to ActionResultIncludesSt…
lina-temporal Feb 5, 2025
107918a
Fix on state based replication (#7228)
xwduan Feb 5, 2025
06dadf8
Reapply WorkflowExecutionOptionsUpdated history event (#7221)
rodrigozhou Feb 6, 2025
61522ea
Batch task queue user data persistence updates (#7039)
dnr Feb 6, 2025
af09a38
Add backward compatibility configs for tally to otel migration (#7235)
yycptt Feb 6, 2025
c156e84
Always use OTEL as metric handler (#7265)
yycptt Feb 6, 2025
83a28d7
use transition history if enabled when long poll history (#7185)
hai719 Feb 6, 2025
0d455c9
Refactor: use Eventually in xdc tests (#7243)
alexshtin Feb 6, 2025
b59b0f8
Fix passing callbacks to continued as new workflow and retries (#7257)
rodrigozhou Feb 6, 2025
a777324
Cleanup state machine timers on machine deletion (#7242)
justinp-tt Feb 6, 2025
50cd0ae
Update Registry suggest CAN (#7247)
stephanos Feb 6, 2025
4a1dffa
Enforce Update Registry size limit (#7254)
stephanos Feb 6, 2025
8e27250
[Reset] Carry over ChildrenInitializedPostResetPoint when continue-as…
gow Feb 6, 2025
6eb0e77
[Reset] Override ID reuse and conflict policy when starting child (#7…
gow Feb 6, 2025
7fc8e02
[Reset] Verify parent before terminating and starting child (#7261)
gow Feb 6, 2025
833193c
Propagate Nexus failure source header to outbound executor metrics (#…
pdoerner Feb 6, 2025
4c96033
Improve cluster metadata and metadata persistence tests (#7249)
jprieto-temporal Feb 6, 2025
45ca3de
Refactor: remove enablerepicator setting from functional test config …
alexshtin Feb 6, 2025
49405d3
Delete Namespace: add stats query to DeleteExecutionsWorkflow (#7264)
alexshtin Feb 6, 2025
d5b2bfb
Fix describe workflow call at standby task verification (#7222)
xwduan Feb 6, 2025
2ade39c
Allow batched user data updates to succeed individually (#7279)
dnr Feb 6, 2025
8b0d8f0
Add Worker Deployment Search Attributes (#7199)
carlydf Feb 6, 2025
2672481
Fix flaky TestForceMigration_ResetWorkflow test (#7278)
alexshtin Feb 6, 2025
6fa077a
Refactor: use xdcBaseSuite for xdc visibility tests (#7272)
alexshtin Feb 6, 2025
f34f860
Upgrade Nexus SDK and API, translate HandlerErrorRetryBehavior (#7263)
bergundy Feb 6, 2025
2640635
Add tracing logs for Nexus HTTP request retries (#7186)
pdoerner Feb 6, 2025
b92009f
RegisterTaskQueue + DescribeVersion: versioning-3.1 (#7107)
Shivs11 Jan 20, 2025
9be0363
Use new versioning fields (#7119)
ShahabT Jan 21, 2025
70b421c
Describe worker deployment in versioning 3.1 (#7127)
Shivs11 Jan 22, 2025
8cfc11c
Support ramp in Matching (#7126)
ShahabT Jan 23, 2025
7546542
flake + unit tests fix (#7149)
Shivs11 Jan 23, 2025
70e7851
SetWorkerDeploymentCurrentVersion: Versioning-3.1 (#7154)
Shivs11 Jan 24, 2025
2aad96c
ListWorkerDeployments : Versioning-3.1 (#7173)
Shivs11 Jan 28, 2025
87ce207
Worker Deployment Version Drainage Status (#7158)
carlydf Jan 29, 2025
ce9314c
Address Drainage PR comments: Pass RegisterVersion info to task queue…
carlydf Jan 29, 2025
7d7d866
ramp - Versioning:3.1 (#7183)
Shivs11 Jan 30, 2025
398ceb4
Upgrade to latest api/versioning-3.1 with new build id -> version naming
ShahabT Feb 4, 2025
1c2d155
Update Deployment Workflow ID's and accept string version values (#7198)
Shivs11 Feb 2, 2025
7a434d5
DeleteVersion API implementation (#7187)
carlydf Feb 2, 2025
064cc12
Use Deployment Version strings in all user-facing APIs (#7219)
ShahabT Feb 3, 2025
8316059
Rename UpdateWorkerDeploymentVersionMetadata
ShahabT Feb 4, 2025
39e46ee
Add Conflict Tokens to Deployment APIs (#7203)
carlydf Feb 4, 2025
58fb455
Test for Wrong Conflict Token (#7238)
carlydf Feb 4, 2025
8675cfc
Poller presence + DeleteVersion (#7205)
Shivs11 Feb 4, 2025
e999c39
pass only version from worker deployment client when starting version…
carlydf Feb 5, 2025
69e03be
Pass task queue types to Describe and take unecessary info out of Tas…
carlydf Feb 5, 2025
b89270e
pass only version from worker deployment client when starting version…
ShahabT Feb 5, 2025
d5cd8c4
UpdateWorkerDeploymentVersionMetadata
Shivs11 Jan 31, 2025
7915d2b
Cleanup Versioning internal protos
Shivs11 Feb 4, 2025
99e8772
Handle Unversioned Current and Ramping Version (#7244)
carlydf Feb 5, 2025
71d9648
DeleteWorkerDeployment
Shivs11 Feb 5, 2025
f816509
handle unset ramp with version verification (#7256)
carlydf Feb 5, 2025
fdf1853
Deployment workflows: update with start -> update (#7260)
Shivs11 Feb 6, 2025
03a3c03
Inherit pinned Version from parent (#7245)
ShahabT Feb 6, 2025
dc398f8
Sync multiple TQ types at once (#7258)
ShahabT Feb 6, 2025
2b901b9
Deletes are now idempotent (#7266)
Shivs11 Feb 6, 2025
f53f6cd
Fix versioning flaky tests
ShahabT Feb 6, 2025
274626a
Describe closed Deployment Workflows returns NotFound + test ListDepl…
carlydf Feb 6, 2025
dcab95b
try to delete version if we are at limit (#7271)
carlydf Feb 6, 2025
db8ceb5
Skip drainage (#7274)
Shivs11 Feb 6, 2025
4dd13d2
reset drainageInfo (#7276)
Shivs11 Feb 6, 2025
208547f
Use MutableSideEffect to access dynamic config from inside workflows …
carlydf Feb 6, 2025
ea3e879
ForceCAN bug fix (#7282)
Shivs11 Feb 6, 2025
ea6a2e6
Change total in-flight update payload size limit (#7277)
stephanos Feb 7, 2025
1e99d45
Export helper for setting Nexus failure source on context (#7286)
pdoerner Feb 7, 2025
6aee988
Log prometheus listener error by default (#7284)
yycptt Feb 7, 2025
5a9bdb6
Fix history batch validations (#7281)
prathyushpv Feb 7, 2025
9a0114b
handle state machine deletion for state-based replication (#7177)
hai719 Feb 7, 2025
f6dcde3
[Reset] Gate auto restarting of children behind the feature flag (#7280)
gow Feb 7, 2025
bac1fa2
Bump nexus-rpc/sdk-go tag to v0.2.0 (#7288)
ShahabT Feb 7, 2025
be00032
forceCAN for worker-deployment (#7283)
Shivs11 Feb 7, 2025
395b235
Bump API to v1.44.0 (#7290)
rodrigozhou Feb 7, 2025
1fdf9fa
Eliminate DescribeWorkerDeployment fan-out (#7292)
ShahabT Feb 7, 2025
1d568d0
Use Worker Deployment Search Attributes (#7287)
carlydf Feb 7, 2025
fdc39ca
Log prometheus listener error at Warn level (#7291)
yycptt Feb 7, 2025
850101f
Test and fix Deployment SAs (#7293)
ShahabT Feb 7, 2025
e370a1e
Bump Server version to 1.27.0-128.0
temporal-data Feb 7, 2025
d68ef0e
Validate Nexus operation token (#7298)
bergundy Feb 8, 2025
c4f8c4c
Bump Server version to 1.27.0-128.1
temporal-data Feb 10, 2025
50d1d76
Revert "Fix history batch validations (#7281)"
prathyushpv Feb 10, 2025
7f1c985
Revert "Send raw history blobs from history service to frontend (#7179)"
prathyushpv Feb 10, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
1 change: 1 addition & 0 deletions .github/workflows/trigger-publish.yml
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ jobs:
private_key: ${{ secrets.TEMPORAL_CICD_PRIVATE_KEY }}

- name: Dispatch docker builds Github Action
if: ${{ vars.SHOULD_TRIGGER_DOCKER_BUILD == 'true' }}
env:
PAT: ${{ steps.generate_token.outputs.token }}
PARENT_REPO: temporalio/docker-builds
Expand Down
12 changes: 0 additions & 12 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -212,18 +212,6 @@ Please don't use very generic titles like "bug fixes".

All PR titles should start with Upper case and have no dot at the end.

## Go build and run tags

Prior to Server version v1.23.0 our protobuf code generator allowed invalid UTF-8 data to be stored as proto strings. This isn't actually allowed by the proto3 spec, so we need to specify `-tags protolegacy` when building against the server. Our Makefile does this, but if you're using temporal as a library you'll need to enable that yourself.

Example:

```shell
$ go build -tags protolegacy ./cmd/server
```

If you see an error like `grpc: error unmarshalling request: string field contains invalid UTF-8` then you've forgotten to specify this flag.

## Go version update

1. In this repository, update `go` in `go.mod`.
Expand Down
11 changes: 3 additions & 8 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -38,10 +38,8 @@ PERSISTENCE_DRIVER ?= cassandra
TEMPORAL_DB ?= temporal
VISIBILITY_DB ?= temporal_visibility

# Always use "protolegacy" tag to allow disabling utf-8 validation on proto messages
# during proto library transition.
ALL_BUILD_TAGS := protolegacy,$(BUILD_TAG)
ALL_TEST_TAGS := $(ALL_BUILD_TAGS),$(TEST_TAG)
ALL_BUILD_TAGS := $(BUILD_TAG),
ALL_TEST_TAGS := $(ALL_BUILD_TAGS),test_dep,$(TEST_TAG)
BUILD_TAG_FLAG := -tags $(ALL_BUILD_TAGS)
TEST_TAG_FLAG := -tags $(ALL_TEST_TAGS)

Expand Down Expand Up @@ -118,10 +116,7 @@ ifeq ($(UNIT_TEST_DIRS),)
UNIT_TEST_DIRS := $(filter-out $(FUNCTIONAL_TEST_ROOT)% $(FUNCTIONAL_TEST_XDC_ROOT)% $(FUNCTIONAL_TEST_NDC_ROOT)% $(DB_INTEGRATION_TEST_ROOT)% $(DB_TOOL_INTEGRATION_TEST_ROOT)% ./temporaltest% ./internal/temporalite%,$(TEST_DIRS))
endif

# github.com/urfave/cli/[email protected] - needs to accept comma in values before unlocking https://github.com/urfave/cli/pull/1241.
PINNED_DEPENDENCIES := \
github.com/go-sql-driver/[email protected] \
github.com/urfave/cli/[email protected]

# Code coverage & test report output files.
TEST_OUTPUT_ROOT := ./.testoutput
Expand Down Expand Up @@ -347,7 +342,7 @@ lint-actions: $(ACTIONLINT)

lint-code: $(GOLANGCI_LINT)
@printf $(COLOR) "Linting code..."
@$(GOLANGCI_LINT) run --verbose --timeout 10m --fix=$(GOLANGCI_LINT_FIX) --new-from-rev=$(GOLANGCI_LINT_BASE_REV) --config=.golangci.yml
@$(GOLANGCI_LINT) run --verbose --build-tags $(ALL_TEST_TAGS) --timeout 10m --fix=$(GOLANGCI_LINT_FIX) --new-from-rev=$(GOLANGCI_LINT_BASE_REV) --config=.golangci.yml

fmt-imports: $(GCI) # Don't get confused, there is a single linter called gci, which is a part of the mega linter we use is called golangci-lint.
@printf $(COLOR) "Formatting imports..."
Expand Down
Loading
Loading