mohamad
22c7d712f4
feat: update flink http client library
2025-04-07 13:20:39 +03:30
mohamad
2dd625ec7c
feat: update flink http client library
2025-04-07 11:28:33 +03:30
mohamad
c991215a9d
Merge branch 'main' of https://git.logicamp.tech/Logicamp/flink-kube-operator
2025-04-06 08:48:54 +03:30
mohamad
1c32bfbbe0
chore: create index and chart package
2025-04-06 01:53:33 +03:30
mohamad
f210090dff
Merge branch 'feature/new-helm-structure' into HEAD
2025-04-06 01:49:21 +03:30
mohamad
54008669cb
fix(helm): wrong savepoint and checkpoint s3 configs
2025-04-06 01:49:00 +03:30
mohamad
830e265162
feat: apply new helm structure
...
use minio s3 for savepoint and checkpoint path
separate task-manager, job-manager and operator
use statefulset for task-manager to handle replication
support basic credential for download jar request
update to flink 1.20.1
2025-04-05 01:39:02 +03:30
mohamad
7f78faeed7
fix(helm): missing task-manager and job-manager configs in values
2025-04-04 13:51:57 +03:30
mohamad
f2b627cee2
feat: add LOG_LEVEL to envs
2025-03-12 23:33:09 +03:30
mohamad
4d6b06efe7
fix: restore watcher if channel is closed
2025-03-12 23:27:40 +03:30
mohamad
6f91ad607f
perf: remove go-nanoid and rxgo
2025-03-12 21:20:57 +03:30
mohamad
b33dc0ba1d
fix: resolve finalize is not working in some cases
2025-03-09 02:17:59 +03:30
mohamad
556d9ff6af
fix: wong update status in some situations
2025-03-05 11:40:22 +03:30
mohamad
346f69100c
fix: resolve missing restrict resources namespace
2025-03-04 23:55:28 +03:30
mohamad
75d0557286
fix(helm): missing namespace env for operator container
2025-03-04 23:14:41 +03:30
mohamad
012c525915
feat(helm): add clusterId to values
2025-03-04 18:05:01 +03:30
mohamad
550b6882e1
fix(helm): missing kubernetes.cluster-id option in flink cluster
2025-03-04 17:46:32 +03:30
mohamad
55dbe9f8c2
feat: add debug logs
2025-02-18 23:08:19 +03:30
mohamad
1ff69e086f
fix(log): add log
2025-01-25 01:05:17 +03:30
mohamad
e60b96cac7
feat(docker): add jnanoid and jdbc connector jar files
2025-01-24 18:13:32 +03:30
mohamad
222d70125c
fix(helm): missing checkpoint interval configuration
2025-01-18 01:32:56 +03:30
mohamad
9629e70ed7
fix(savepoint): wrong savepoint path in download savepoint route
2025-01-18 01:32:24 +03:30
mohamad
e32addcea5
fix(helm): missing checkpoint interval configuration
2025-01-18 01:31:53 +03:30
mohamad
625d5056e6
feat: merge operator to flink deployment
2025-01-18 01:14:40 +03:30
mohamad
6591748d16
fix: resolve savepoint trigger no SavepointTriggerId problem
2025-01-18 00:31:05 +03:30
mohamad
8f3c32ed95
fix: resolve missing handle job not found
2025-01-17 22:48:29 +03:30
mohamad
4bbb027c41
fix: resolve job start after pause bug
2025-01-17 21:16:38 +03:30
mohamad
896d45e15a
fix: resolve crash operator in some cases
2025-01-17 21:11:17 +03:30
mohamad
322877ad8e
fix: resolve job start after pause bug
2025-01-17 21:09:53 +03:30
mohamad
5066dc650f
feat: add start and trigger savepoint routes
2025-01-17 20:27:32 +03:30
mohamad
c977c8a15d
feat: add download savepoint route
2025-01-17 18:34:06 +03:30
mohamad
14aba80181
feat: separate job-manager and task-manager containers
2025-01-10 12:39:54 +03:30
mohamad
4cd00f25f0
feat: limit control to single current only namespace
2025-01-10 12:30:15 +03:30
mohamad
0df874b222
feat: add rest routes to take the control of flink jobs
2025-01-09 00:22:53 +03:30
mohamad
4dd82c6380
ci(docker): flink docker > add jdbc and postgress cdc and postgres sink jars
2024-12-26 22:20:57 +03:30
mohamad
e4f756666d
fix: missing savepoint path env in operator deployment
2024-12-25 01:46:20 +03:30
mohamad
0bc45845dc
fix(flink): wrong upload dir prop
2024-12-20 18:09:55 +03:30
mohamad
b8e051911e
fix(flink): wrong upload dir prop
2024-12-20 18:05:38 +03:30
mohamad
b6e2838756
feat(flink): add readiness and liveness probe
2024-12-20 17:57:55 +03:30
mohamad
8fa99f4ea8
fix(flink): wrong ha path
2024-12-20 17:56:13 +03:30
mohamad
23a4de92e4
fix: missing ha pvc
2024-12-20 17:22:32 +03:30
mohamad
37936c8c58
feat: separate ha and checkpoint pvc
2024-12-20 17:12:51 +03:30
mohamad
4ed533f284
fix(manage-job): missing patch kube resource after run job
2024-12-20 14:45:29 +03:30
mohamad
00030195c8
perf(helm): flink-deployment > remove unneeded mount
2024-12-19 00:40:16 +03:30
mohamad
7e33fd6cef
fix: wrong life-cycle-status after job failed
2024-12-18 11:12:08 +03:30
mohamad
5bc047dbd1
feat(managed-job): add args and parallelism param to run flink job method
2024-12-18 11:08:21 +03:30
mohamad
07b8a36e63
feat: add avro and exp4j jar
2024-12-18 10:51:53 +03:30
mohamad
5e3f093f08
feat: handle job run error and change life-cycle status
2024-12-18 10:08:30 +03:30
mohamad
03fe9910a3
feat: add clickhouse and postgres support
2024-12-16 09:28:26 +03:30
mohamad
438296ec35
docs: update readme for helm repo
2024-12-15 10:27:34 +03:30
mohamad
6a475c7755
feat: add repo for helm chart
2024-12-15 10:24:38 +03:30
mohamad
a3a806a54f
Merge remote-tracking branch 'origin/feature/kube-crd-control'
2024-12-15 10:16:46 +03:30
mohamad
9086f6664e
fix: resolve leftover jar file issue after upload
2024-12-13 20:12:52 +03:30
mohamad
9f36dca7c9
fix: prevent concurrent jobs map writes by adding synchronization
...
This fix prevents undefined behavior and runtime crashes in multithreaded
use cases.
2024-12-13 20:11:58 +03:30
mohamad
02d8f0b02e
fix: resolve remain jar file after upload
2024-12-13 19:51:26 +03:30
mohamad
d36b9c30df
fix: resolve issue with jar upgrade not uploading new jar
...
Ensure the new jar is properly uploaded during an upgrade process. Previously, the jar was not replaced as expected.
2024-12-13 19:41:59 +03:30
mohamad
699cf12f72
fix(savepoint): periodically savepoint bug
2024-12-13 15:11:36 +03:30
mohamad
444cfc7061
feat: optimize logs
2024-12-13 15:06:02 +03:30
mohamad
08407afe1e
fix(jar): not returned error on download returns not 200 resp
2024-12-13 15:01:21 +03:30
mohamad
9b219d967e
feat: handle upgrade job
2024-12-13 15:00:43 +03:30
mohamad
89702d287a
fix(savepoint): missing savepoint path env and not handled savepoint errors
2024-12-13 14:57:55 +03:30
mohamad
b2d2295d07
feat: allow restore jobs that has not any taken save point
2024-12-13 02:50:43 +03:30
mohamad
c066a9fd90
ci: add tilt file
2024-12-13 02:49:40 +03:30
mohamad
5543f5ea79
feat(helm): enable ha for Flink cluster deployment
2024-12-13 02:49:21 +03:30
mohamad
a22198011c
perf: optimize docker image size
2024-12-13 02:48:19 +03:30
mohamad
5bf3571e4b
fix(helm): no config-map error in operator deployment
2024-12-13 02:47:54 +03:30
mohamad
d3fd04b20c
perf: remove lc dependency
2024-12-12 23:13:54 +03:30
mohamad
3912ecef44
fix(helm): wrong flink checkpoint and savepoint dirs config
2024-12-09 01:51:40 +03:30
mohamad
f06a391359
feat(docker): add avro and kafka-connector flink libs
2024-12-09 01:50:29 +03:30
mohamad
d934541bbf
feat(helm): add web.upload.dir
2024-12-09 01:29:03 +03:30
mohamad
96880f1886
feat: add role and role binding
2024-12-09 01:26:00 +03:30
mohamad
204f25a6af
feat: add config.yaml to to operator
2024-12-09 00:54:40 +03:30
mohamad
454cd8aae8
fix(docker): no foreground task in docker
2024-12-09 00:54:19 +03:30
mohamad
d909765afc
ci(helm): add helm chart
2024-12-08 22:03:05 +03:30
mohamad
a178db87fb
ci(docker): init docker files
2024-12-08 22:00:26 +03:30
mohamad
bc20345fc0
feat: add early update job def into patch
2024-12-08 19:29:05 +03:30
mohamad
0993ed4cb1
fix(jar): bug on remove temporary jar
2024-12-08 19:25:31 +03:30
mohamad
91ccfebfeb
feat: retry upload on jar not found
2024-12-08 01:24:14 +03:30
mohamad
5abc044d69
feat: add restore statuses to kubernetes crd
2024-12-08 00:47:53 +03:30
mohamad
c5b19d3336
feat: remove buntdb dep
2024-12-07 22:12:46 +03:30
mohamad
2c25323e62
feat(manager): make check status from flink batch
2024-12-07 01:09:25 +03:30
mohamad
d1a715deea
feat: add drawio
2024-12-06 19:27:05 +03:30
mohamad
ebd4a61f74
feat: remove buntdb deps
2024-12-02 00:01:26 +03:30
mohamad
e42731858d
feat: remove buntdb deps
2024-12-02 00:01:03 +03:30
mohamad
3e77ac121a
feat(crd): add update custom resource status
2024-12-01 23:55:58 +03:30
mohamad
fb646086b0
feat(managed-job): add update job method
2024-12-01 02:05:49 +03:30
mohamad
ac8453bb57
feat: add flinkApiUrl and database path configs
2024-12-01 02:05:21 +03:30
mohamad
dd700b6007
feat(managed-job): add restore from failed state
2024-12-01 00:56:16 +03:30
mohamad
64e84c8d0f
fix: create multiple managedJob instance
2024-12-01 00:07:30 +03:30
mohamad
6bd197b812
feat: add manager
2024-11-30 23:36:44 +03:30
mohamad
d8b87ac6ee
feat: change db to buntdb
2024-11-30 21:08:06 +03:30
mohamad
412a5292cb
feat(crd): update crd type
2024-11-30 20:52:12 +03:30
mohamad
b0ff04126a
feat: add type to get watch crd result
2024-11-30 19:31:36 +03:30
mohamad
19b874cba6
feat(crd): add kube api and crds
2024-11-30 19:04:02 +03:30
mohamad
e95634c942
feat(config): add savepoint interval config
2024-11-30 02:18:44 +03:30
mohamad
8f4cb093b1
feat(savepoint): create and track for getting savepoint location
2024-11-30 02:11:30 +03:30
mohamad
3b0aff5688
feat: initialize
2024-11-30 01:22:51 +03:30
mohamad