feat: Enable batch import of SST files with S3/MinIO in Pika#3175

Closed

byseea11 wants to merge 1370 commits intoOpenAtomFoundation:3.5from

byseea11:pika-ingest-v3.5

This pull request is big! We're only showing the most recent 250 commits

Commits on Feb 2, 2024

fix: fix delete dump file while still in use (#2377)

wangshao1
and
wangshaoyi
authored
fix keyspace's result wrong (#2369)

Mixficsol
and
wuxianrong
authored
fix: update 'info replication command' output format about db which add a colon #2375 (#2384)

chengyu-l
and
liuchengyu
authored

Commits on Feb 7, 2024

Commits on Feb 27, 2024

Update pika_migrate_thread.cc (#2415)

chejinge
authored and
brother-jin
committed
fix lock

chejinge
authored and
brother-jin
committed
fix lock
brother-jin
committed

Commits on Mar 4, 2024

Update pika_version.h (#2443)

chejinge
authored and
brother-jin
committed

Commits on Mar 5, 2024

fix: ACL user authentication errors

lqxhub
authored and
brother-jin
committed

Commits on Mar 7, 2024

add rename command (#2462)
Mixficsol
authored

Commits on Mar 18, 2024

fix: Fix the problem of possible slave_key conflict (#2431)

happy-v587
authored and
luky116
committed
feat: pika supports kubeblocks component definition api (#2411)

xingran
authored and
luky116
committed
feat: support dynamic set max-conn-rbuf-size (#2434)

happy-v587
authored and
luky116
committed
fix ci replication go test failed problem (#2435)

authored and
luky116
committed
fix not syncing (#2430)

authored and
luky116
committed
Fix the initial authentication status of the ACL user and the ACL permission judgment after the default user is connected (#2449)

lqxhub
authored and
luky116
committed
fix: return kErr status when Master handle MetaRsync reqeust if db is not exist or doing bgsave(#2289) (#2437)

authored and
luky116
committed
fix: after full synchronization fails, full synchronization will be skipped directly(#2433) (#2439)

authored and
luky116
committed
fix: linux arm64 spelling mistake in Makefile of pika_exporter(#2456) (#2457)

authored and
luky116
committed
add tcl go test (#2464)

authored and
luky116
committed
fix: acl forward compatible (#2459)

dingxiaoshuai123
authored and
luky116
committed
Integration tests differentiate between cached and non-cached (#2467)

luky116
and
liuyuecai
committed
feat:add issue translation robot (#2478)

lqxhub
authored and
luky116
committed
fix: support removing pika instance from codis dashboard before pod stop (#2475)

authored and
luky116
committed
fix: support saving pika config to hostpath (#2476)

authored and
luky116
committed
fix: no namespace in configmap, so remove the namespace (#2474)

authored and
luky116
committed
fix: move Dockerfile and build_docker.sh into docker subdirectory (#2458)

authored and
luky116
committed
feat: support building pika_exporter docker image (#2451)

authored and
luky116
committed
add rename-command go test (#2468)

Mixficsol
authored and
luky116
committed
ci: cleanup code (#2479)

baerwang
authored and
luky116
committed
feat: support deploying pika_exporter components using kubeblocks (#2473)

authored and
luky116
committed
fix: fix github action CI failure (#2491)
luky116
committed
test: add replication-test-go (#2496)

Mixficsol
authored and
luky116
committed
feat: add tcl test (#2497)

authored and
luky116
committed
test: add acl and userBlackList test (#2495)
luky116
committed
fix:dbsize caculate error (#2494)

chejinge
authored and
luky116
committed
fix:Binlog is written repeatedly && not delete cache (#2485)

authored and
luky116
committed
feat:add multi key slot migrate (#2486)

authored and
luky116
committed
feat:add namespace for kubeblocks pika cluster helm chart (#2480)

Y-Rookie
authored and
luky116
committed
test: add codis integration test (#2502)

luky116
and
liuyuecai
committed
delete unsed log

liuyuecai
authored and
luky116
committed
fix lock bug (#4)

Mixficsol
authored and
luky116
committed
fix Eventually timeout

liuyuecai
authored and
luky116
committed
add timeout param

liuyuecai
authored and
luky116
committed
fix:delete cache log

brother-jin
authored and
luky116
committed
fix lock (#5)

authored and
luky116
committed
temp remove some intergration test for bugs

liuyuecai
authored and
luky116
committed
fix: replace del of flushdb (#7)

authored and
luky116
committed

Commits on Mar 19, 2024

fix: fix dead lock bug (#2529)
luky116
authored

Commits on Mar 21, 2024

fix: added some disable command additions to the rename-command (#2540)

Mixficsol
and
wuxianrong
authored

Commits on Mar 22, 2024

unstable
brother-jin
committed
fix:353 changelog (#2544)

chejinge
and
brother-jin
committed

Commits on Apr 3, 2024

fix:some conf load error (#2561)

chejinge
and
brother-jin
committed

Commits on Apr 7, 2024

Commits on Apr 8, 2024

Commits on Apr 16, 2024

Commits on Apr 17, 2024

354 version (#2604)

chejinge
and
brother-jin
authored
fix: data structure tcl bugfix (#2527)

Mixficsol
authored and
brother-jin
committed
clean-dir (#2507)

authored and
brother-jin
committed
test: Comment unavailable tcl test cases (#2528)

zhjinliang
authored and
brother-jin
committed
chore: release add centos for os and optimization (#2535)

baerwang
authored and
brother-jin
committed
docs: changelog of v3.5.4-rc1 (#2605)

chejinge
and
brother-jin
committed

Commits on Apr 22, 2024

Commits on Apr 25, 2024

fix:cache_disable_flag assign initial value (#2613)

chejinge
and
brother-jin
committed

Commits on May 9, 2024

fix macos CI in github action (#2627)

cheniujh
authored and
brother-jin
committed
fix:slave parse tnx binlog failed (#2642)

chejinge
and
brother-jin
committed

Commits on May 15, 2024

Commits on Jun 4, 2024

feat:mget support multi get (#2694)

chejinge
and
brother-jin
authored

Commits on Jun 12, 2024

fix: fix acl bug (#2714)

authored and
brother-jin
committed

Commits on Jun 14, 2024

fix:ttl will deafult 0 when keys have ttl (#2729)

chejinge
and
brother-jin
authored
fix:pkpatternmatchdel support stream type (#2723)

wangshao1
and
wangshaoyi
authored

Commits on Jun 24, 2024

fix: Pika can not exec full-sync when multi slaves connect to the same master within a short time (#2746)

cheniujh
authored and
brother-jin
committed

Commits on Jun 25, 2024

fix:pksetexat should update cache (#2759)

chejinge
and
brother-jin
authored

Commits on Jul 8, 2024

delete iter before return (#2786)

wangshao1
and
wangshaoyi
authored

Commits on Jul 18, 2024

add streams data column-family compactionfilter (#2799)

wangshao1
and
wangshaoyi
authored

Commits on Jul 29, 2024

fix: slotmigrate return not correct (#2741)

chejinge
and
brother-jin
committed

Commits on Jul 31, 2024

docs: modify run pika in docker readme (#2743)

authored and
brother-jin
committed
fix: Revised RocksDB-Related Parameters in Pika (#2728)

cheniujh
authored and
brother-jin
committed
add repl metric "repl_connect_status" in the resp of info command (#2656)

cheniujh
authored and
brother-jin
committed
removed keys_mutex.unlock() (#2657)

cheniujh
authored and
brother-jin
committed
feat: add a new test env (rocky linux) in github ci. (#2806) (#2823)

QlQlqiqi
authored and
brother-jin
committed
fix: make SlaveDB stay in WaitDBSync state instead of sink into Error State if rsync init failed (#2667)

cheniujh
authored and
brother-jin
committed
fix: Reconstruct slave sync thread model (#2638)

cheniujh
authored and
brother-jin
committed
fix the problem that BinlogAckEnd smaller than BinlogAckStart(due to the Master clean un-relevant WriteQueue when one DB timeout) (#2666)

cheniujh
authored and
brother-jin
committed
fix: fix data race around spop Dobinlog (#2674)

cheniujh
authored and
brother-jin
committed
fix exec_count_db data race issue (#2671)

cheniujh
authored and
brother-jin
committed
add back the override Execute() of WatchCmd, InfoCmd, ConfigCmd (#2693)

cheniujh
authored and
brother-jin
committed
update CI
brother-jin
committed
Update migrator_thread.cc (#2758)

guangkun123
authored and
brother-jin
committed
refactor: geo related tcl tests (#2753)

saz97
authored and
brother-jin
committed

Commits on Aug 1, 2024

feat:thread purge (#2697)

chejinge
and
brother-jin
committed
refeator log (#2702)

chejinge
authored and
brother-jin
committed
test: add pika benchmark tools (#2663)

authored and
brother-jin
committed
feat:Split the admin command out of the main thread (#2727)

chejinge
and
brother-jin
committed
fix:zverank return error (#2763)

chejinge
and
brother-jin
committed
fix min-blob-size parse error (#2767)

authored and
brother-jin
committed
fix: github action centos CI can’t pull dependencies (#2772)

cheniujh
authored and
brother-jin
committed
remove an unnecessary shared_lock in a hot path(every request will conduct this unnecessary lock) (#2773)

cheniujh
authored and
brother-jin
committed
docs: v4.0.0 changelog (#2764)

chejinge
and
brother-jin
committed
fix: incr sync shouldn't be established after full sync corrupted (#2756)

cheniujh
authored and
brother-jin
committed
fix:delete iter before PKPatternMatchDel returns
brother-jin
committed
fix:400changelog (#2788)

chejinge
and
brother-jin
committed
fix: revised TimerTaskManager and add some comments (#2776)

cheniujh
authored and
brother-jin
committed
set slaveNode to DBSync status before commit bgsave task (#2798)

cheniujh
authored and
brother-jin
committed
fix: add metric is_eligible_for_master_election to support reelection decision in codis-sentinel (#2766)

authored and
brother-jin
committed
add function DeactivateSyncSlaveDB (#2801)

cheniujh
authored and
brother-jin
committed
draft fix of bgsave's inconsistent problem (#2818)

cheniujh
authored and
brother-jin
committed
feat: add more cache info (#2797)

bigdaronlee163
authored and
brother-jin
committed
fix:slave_prorority need to be 100 when used redis sentinel (#2813)

chejinge
and
brother-jin
committed
fix: successive exec of flushdb may cause delete old db fail (#2790)

cheniujh
authored and
brother-jin
committed

Commits on Aug 6, 2024

feat: use RTC(Run-to-completion) model to speed up cache read (#2837)

authored and
brother-jin
committed
fix: flushdb may cause master-slave inconsistency (#2808)

authored and
brother-jin
committed
fix:delete logs (#2840)

chejinge
and
brother-jin
committed
fix: add switch for RTC cache read (#2841)

cheniujh
authored and
brother-jin
committed

Commits on Aug 7, 2024

Commits on Aug 8, 2024

feat:Added the periodically clearing serverlog function (#2829)

authored and
brother-jin
committed
fix:355 CI (#2851)

chejinge
and
brother-jin
authored
test: fix multi bug and compatible ACL test (#2844)

luky116
and
liuyuecai
authored

Commits on Aug 9, 2024

fix:update version (#2856)
chejinge
authored
make flushall write binlog of flushdb (#2846)

cheniujh
authored and
brother-jin
committed

Commits on Aug 12, 2024

Commits on Aug 13, 2024

fix: kill connections correctly in Net WorkThread (#2862)

cheniujh
authored and
brother-jin
committed
fix: make pika compactible with redis-sentinel (#2854)

authored and
brother-jin
committed

Commits on Aug 14, 2024

Commits on Aug 20, 2024

fix: v3.5.5 changelog patch (#2877)

authored and
brother-jin
committed

Commits on Sep 24, 2024

Commits on Dec 25, 2024

feat: dont store cmd(Get/Set/Hget/Hset) with too large key in cache (#2849)

QlQlqiqi
authored and
brother-jin
committed
feat:Update kubeblocks version to 0.9 (#2860)

XiaoLiang2333
authored and
brother-jin
committed
feat:add test for redis commands, including LPush, RPushX, BgSave, FlushDb and SetEx (#2901)

authored and
brother-jin
committed
bump: upgrade actions (#2910)

baerwang
authored and
brother-jin
committed
feat:pika-master-slave-cluster in kb (#2903)

XiaoLiang2333
authored and
brother-jin
committed
fix:fix CI (#2924)

chejinge
and
brother-jin
committed
fix:macos13 (#2937)

chejinge
and
brother-jin
committed

Commits on Dec 26, 2024

fix:lpop and lpushx test (#2985)

chejinge
and
brother-jin
authored
fix:slash test (#2986)

chejinge
and
brother-jin
authored

Commits on Dec 27, 2024

docs:Pika wechat (#2915)

chejinge
and
brother-jin
committed
docs:pika wechat (#2917)

chejinge
and
brother-jin
committed
move declare position of in_conn to avoid unnecessary extra Ref from shared_ptr (#2904)

cheniujh
authored and
brother-jin
committed
fix: fix log_level (#2948)

buzhimingyonghu
authored and
brother-jin
committed
fix:log level
brother-jin
committed
fix: pika exporter error output due to versions dismatch (#2951)

buzhimingyonghu
authored and
brother-jin
committed
fix: fix user ERR NOAUTH Authentication required (#2939)

buzhimingyonghu
authored and
brother-jin
committed
fix: Merge Pika-migrate into the tools directory of the unstable branch (#2941)

chenbt-hz
authored and
brother-jin
committed
Update README.md

Mixficsol
authored and
brother-jin
committed
fix: user ERR NOAUTH in github action (#2962)

buzhimingyonghu
authored and
brother-jin
committed

Commits on Dec 30, 2024

feat:finish backup and restore (#2968)

buzhimingyonghu
authored and
brother-jin
committed
feat:zmax && zmin (#2966)

chejinge
and
brother-jin
committed
fix: fix pika exporter 336 version match nil and delete optional logs keyspace-stats-clock (#2971)

buzhimingyonghu
authored and
brother-jin
committed
make log-retention-time dynamically changeable (#2963)

cheniujh
authored and
brother-jin
committed
feat: add repl_connect_status to pika_exporter (#2961)

cheniujh
authored and
brother-jin
committed
persist the salveof conf item when slaveof no one is executed (#2973)

cheniujh
authored and
brother-jin
committed
feat: add log-net-activities configuration (#2964)

authored and
brother-jin
committed
ensure rpoplpush can update cache (#2976)

cheniujh
authored and
brother-jin
committed
fix RpushLpop
brother-jin
committed
feat:4.0.2 changelog && add some test (#2977)

chejinge
authored and
brother-jin
committed
fix:release wrong (#2979)

chejinge
and
brother-jin
committed

Commits on Jan 8, 2025

fix：initialize the struct member (#2992)

chejinge
and
brother-jin
committed

Commits on Feb 10, 2025

fix: hello command not return information of pika version (#2990)
pro-spild
authored

Commits on Feb 11, 2025

fix: Change the maximum range of setbit's offset to fit redis v3.5 (#3007)

Mixficsol
and
wuxianrong
authored
feat:Hset35 (#3005)

chejinge
and
brother-jin
authored
fix: Change the maximum range of setbit's offset to fit redis (#2995)

authored and
brother-jin
committed
feat:new big key count (#3009)

chejinge
and
brother-jin
authored

Commits on Mar 3, 2025

fix ci (#3035)

Mixficsol
and
wuxianrong
authored

Commits on Mar 5, 2025

fix: Reduced ReadCache tags for some commands (#3034)

Mixficsol
and
wuxianrong
authored

Commits on Mar 6, 2025

fix: Fixed an issue with asynchronous loading (#3037)

Mixficsol
and
wuxianrong
authored
summary different stages duration && add rocksdb perfcontext (#3036)

wangshao1
and
wangshaoyi
authored

Commits on Mar 14, 2025

Commits on Mar 17, 2025

Example Modify the policy for updating big keys except String to Redis-Cache (#3047)

Mixficsol
and
wuxianrong
authored

Commits on Mar 19, 2025

add auth command to admin-thread-pool (#3048)

Mixficsol
and
wuxianrong
authored
fix: Example Repair the subjective and objective offline logic of noeds (#3049)

Mixficsol
and
wuxianrong
authored
fix: fix exit core (#3050)

Mixficsol
and
wuxianrong
authored

Commits on Mar 20, 2025

Commits on Mar 21, 2025

Revert "fix slowcmd log duration error with batch command && add proxy metrics && reset proxy tp duration in 1 min (#3044)" (#3056)

wangshao1
and
wangshaoyi
authored
fix: Fixed versions of Pika, Pika_exporter, Codis (#3057)

Mixficsol
and
wuxianrong
authored

Commits on Mar 27, 2025

correction maximum range (#3064)

Mixficsol
and
wuxianrong
authored

Commits on Apr 2, 2025

Force CMake to run with the policy behavior of version 3.5 to avoid cases where a higher version of CMake does not compile

Mixficsol
and
wuxianrong
authored

Commits on Apr 8, 2025

fix: added the correct loading of admin-cmd-list in the configuration file (#3076)

Mixficsol
and
wuxianrong
authored

Commits on Jun 9, 2025

Commits on Jun 12, 2025

fix: block-cache & blob-cache bug (#3105)
chenbt-hz
authored
fix telnet core dump (#3099)

Mixficsol
and
wuxianrong
authored

Commits on Jun 13, 2025

Fix the error bugs in getrange and setrange in pika 3.5 version (#3106)

YuCai18
and
caiyu
authored
fix connections overflow when command processing takes too long and client close connection (#3089)

wangshao1
and
wangshaoyi
authored
Modify the ZAdd function in redis_zsets to read the array from back to front (#3108)

YuCai18
and
caiyu
authored
fix proxy log print error && request time stat error (#3107)

wangshao1
and
wangshaoyi
authored

Commits on Jun 16, 2025

skip processing command while associated connection has been closed (#3111)

wangshao1
and
wangshaoyi
authored

Commits on Jun 20, 2025

fix: requirepass allows connection with any non-empty password (#3113)

YuCai18
and
caiyu
authored

Commits on Jul 14, 2025

Delete the print of the inconsequential log (#3119)
YuCai18
authored

Commits on Jul 15, 2025

fix spop resp format to compatible with php redis client (#3129)
wangshao1
authored

Commits on Jul 22, 2025

Fix bug in time statistics format (#3134)
YuCai18
authored

Commits on Jul 29, 2025

stat pipeline num when printing slowlog (#3142)

wangshao1
and
wangshaoyi
authored

Commits on Jul 30, 2025

Revert "Fix bug in time statistics format (#3134)" (#3143)
wangshao1
authored

Commits on Sep 5, 2025

fix:unused conf (#3155)

chejinge
and
brother-jin
authored

Commits on Sep 8, 2025

Commits on Sep 30, 2025

feat: Enable batch import of SST files with S3/MinIO in Pika
byseea11
committed