Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. Weโ€™ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

INTERNAL: Remove redudant operation type RW. #879

Merged
merged 1 commit into from
Feb 21, 2025

Conversation

brido4125
Copy link
Collaborator

@brido4125 brido4125 commented Feb 19, 2025

๐Ÿ”— Related Issue

https://github.com/jam2in/arcus-works/issues/692

โŒจ๏ธ What I did

CollectionGet ์—ฐ์‚ฐ์˜ ๊ฒฝ์šฐ dropIfEmpty ๋˜๋Š” withDelete ๋“ฑ์˜
์˜ต์…˜์— ์˜ํ•ด write ์—ฐ์‚ฐ์ด ๋  ๊ฐ€๋Šฅ์„ฑ์„ ๊ฐ€์ง„ read ์—ฐ์‚ฐ์ด๋‹ค.

์ด์ „์—๋Š” ์ด๋ฅผ ๊ตฌ๋ณ„ํ•˜๊ธฐ ์œ„ํ•ด OperationType.RW๋ฅผ ์‚ฌ์šฉํ–ˆ์ง€๋งŒ
setAPIReadPriority ๋ฉ”์„œ๋“œ์—์„œ๋งŒ ํ•ด๋‹น ํƒ€์ž…์ด ์‚ฌ์šฉ๋œ๋‹ค.

์ด ํƒ€์ž…์„ ์ œ๊ฑฐํ•˜๊ณ  ๋””ํดํŠธ๋กœ๋Š” read๋ฅผ ์„ค์ •ํ•˜๊ณ 
CollectionGetOperationImpl ์ƒ์„ฑ์ž์—์„œ
dropIfEmpty์™€ withDelete ์—ฌ๋ถ€๋ฅผ ํ™•์ธ ํ•œ ๋‹ค์Œ
write ํƒ€์ž…์œผ๋กœ ๋ณ€๊ฒฝํ•˜๋„๋ก ํ•œ๋‹ค.
(๊ธฐ์กด ์ƒ์„ฑ์ž์—์„œ๋Š” dropIfEmpty๋ฅผ ํ™•์ธํ•˜์ง€ ์•Š์•˜๋‹ค)

์ถ”๊ฐ€์ ์œผ๋กœ collectionGet์ด read ํƒ€์ž…์ด ๋””ํดํŠธ์ด๊ธฐ ๋•Œ๋ฌธ์—
apiReadPriorityList์— readPriority๋ฅผ ์„ค์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.

collectionGet ์—ฐ์‚ฐ์€ op๊ฐ€ ์ƒ์„ฑ๋œ ํ›„์— replica pick์„ ์„ค์ •ํ•˜๋Š” api ์ด๊ธฐ ๋•Œ๋ฌธ์—
write ์—ฐ์‚ฐ์ž„์—๋„ readPriority๊ฐ€ ์„ค์ •๋˜๋Š” ๋ฒ„๊ทธ๊ฐ€ ๋ฐœ์ƒํ•˜์ง€๋Š” ์•Š๋Š”๋‹ค.

@brido4125 brido4125 self-assigned this Feb 19, 2025
@brido4125
Copy link
Collaborator Author

@uhm0311 @oliviarla

๋ฆฌ๋ทฐ ๋…ธํ‹ฐ ํ•œ๋ฒˆ ๋” ๋“œ๋ฆฝ๋‹ˆ๋‹ค

oliviarla
oliviarla previously approved these changes Feb 21, 2025
@brido4125 brido4125 requested a review from jhpark816 February 21, 2025 02:04
Copy link
Collaborator

@jhpark816 jhpark816 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

๋ฆฌ๋ทฐ ์™„๋ฃŒ

setOperationType(OperationType.WRITE);
} else {
setOperationType(OperationType.READ);
if (collectionGet.isDelete() || collectionGet.isDropIfEmpty()) {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

collectionGet.isDropIfEmpty() ์กฐ๊ฑด์€ ์ œ๊ฑฐํ•ฉ์‹œ๋‹ค.

delete๊ฐ€ false์ด๋ฉด dropIfEmpty๊ฐ€ true์ด๋”๋ผ๋„ delete๊ฐ€ ์ˆ˜ํ–‰๋˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.

@jhpark816 jhpark816 merged commit 8c9a6e3 into naver:develop Feb 21, 2025
2 checks passed
@oliviarla
Copy link
Collaborator

oliviarla commented Feb 24, 2025

์ด pr์—์„œ ๋ฒ„๊ทธ๊ฐ€ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค.

enum ํƒ€์ž…์€ ์‹ฑ๊ธ€ํ†ค์œผ๋กœ ๊ด€๋ฆฌ๋˜๊ธฐ ๋•Œ๋ฌธ์— ํ•œ๋ฒˆ OperationType์„ ๋ฐ”๊พธ๋ฉด ๋‹ค๋ฅธ ๊ณณ์—์„œ ๊ฐ์ฒด๋ฅผ ๊ฐ€์ ธ์˜ฌ ๋•Œ ๋ฐ”๋€Œ์–ด์ง„ ๊ฐ’์„ ๊ฐ€์ ธ์˜ค๊ฒŒ ๋ฉ๋‹ˆ๋‹ค. ๋”ฐ๋ผ์„œ RW ํƒ€์ž…์„ ๊ทธ๋Œ€๋กœ ์œ ์ง€ํ•˜๊ฑฐ๋‚˜ ๋‹ค๋ฅธ ๋ฐฉ๋ฒ•์„ ์ƒ๊ฐํ•ด๋ณด์•„์•ผ ํ•ฉ๋‹ˆ๋‹ค.

@Test
void test() {
  ListGet listGet = new ListGet(0, true, true);
  CollectionGetOperationImpl op = new CollectionGetOperationImpl("key", listGet, null);
  APIType type1 = op.getAPIType();
  assertEquals(OperationType.WRITE, type1.getAPIOpType());
  
  ListGet listGet2 = new ListGet(0, false, false);
  CollectionGetOperationImpl op2 = new CollectionGetOperationImpl("key", listGet2, null);
  APIType type2 = op2.getAPIType();
  assertEquals(OperationType.READ, type2.getAPIOpType()); // OperationType.WRITE๊ฐ€ ๋ฐ˜ํ™˜๋˜์–ด ํ…Œ์ŠคํŠธ๊ฐ€ ์‹คํŒจํ•œ๋‹ค.
}

@jhpark816
Copy link
Collaborator

jhpark816 commented Feb 24, 2025

@brido4125
์œ„์˜ ์ฝ”๋ฉ˜ํŠธ ํ™•์ธํ•˜์‹œ๊ณ ,
๊ธฐ์กด์— api type๊ณผ operation type์ด ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค.
operation type์€ read or write ์—ฌ๋ถ€๋ฅผ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.
api type์€ ์–ด๋–ค ์šฉ๋„์ธ๊ฐ€์š”?

@brido4125
Copy link
Collaborator Author

@jhpark816

api type์€ ์–ด๋–ค ์šฉ๋„์ธ๊ฐ€์š”?

ํ˜„์žฌ ๊ตฌํ˜„ ์ƒ์œผ๋กœ๋Š” API Read Priority๋ฅผ ์„ค์ •ํ•˜๊ณ 
์ด๋ฅผ ์‚ฌ์šฉํ•  ๋•Œ ํ™œ์šฉ๋˜๋Š” ์šฉ๋„์ž…๋‹ˆ๋‹ค.

์•„๋ž˜ PR์ด ๋ฐ˜์˜๋  ๊ฒฝ์šฐ์—๋Š” api type์„ ํ†ตํ•ด์„œ
opType์„ ์‚ฌ์šฉํ•˜๋Š” ์šฉ๋„๋„ ์ถ”๊ฐ€๋ฉ๋‹ˆ๋‹ค.
#883

@oliviarla
์• ์ดˆ์— RWํƒ€์ž…์ด ์‚ฌ์šฉ๋˜๋Š” ๊ณณ์ด collectionGet์—์„œ๋งŒ ์‚ฌ์šฉ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.
๊ทธ๋ž˜์„œ RW ํƒ€์ž…์ด ์—ฌ๋Ÿฌ api์—์„œ ์‚ฌ์šฉ๋˜๋ฉด ์œ ์ง€์‹œํ‚ค๋Š”๊ฒŒ ์ข‹์„ ๊ฒƒ ๊ฐ™์€๋ฐ
๊ทธ๋ ‡์ง€ ์•Š์œผ๋‹ˆ ์ฐจ๋ผ๋ฆฌ ApiType์„ ์•„๋ž˜์™€ ๊ฐ™์ด ์ถ”๊ฐ€์‹œํ‚ค๋Š”๊ฒŒ ์ข‹์„ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.

  LOP_GET(OperationType.READ),
  LOP_GET_DELETE(OperationType.WRITE),

@jhpark816
Copy link
Collaborator

@brido4125 @oliviarla
api type ์ž์ฒด์˜ ์šฉ๋„๊ฐ€ ์—†๋‹ค๋Š” ๊ฒƒ์ด๋„ค์š”.
๊ทธ๋Ÿฌ๋ฉด, operation type์„ ๋‹ค์‹œ ๋‘๊ณ , api type์„ ์ œ๊ฑฐํ•˜๋Š” ๊ฒƒ์ด ๋‚˜์„ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค. ๊ฒ€ํ† ํ•ด ์ฃผ์„ธ์š”.

@brido4125
Copy link
Collaborator Author

@jhpark816

๊ทธ๋Ÿฌ๋ฉด API Type์— ๋”ฐ๋ผ read Priority๋ฅผ ์„ค์ •ํ•  ์ˆ˜ ์žˆ๋Š” ๊ธฐ๋Šฅ์„ ์ œ๊ฑฐํ•˜๋‚˜์š”?

@brido4125
Copy link
Collaborator Author

@jhpark816 @oliviarla

์•„๋ž˜ ์ฝ”๋ฉ˜ํŠธ์ฒ˜๋Ÿผ ์ด๋ฏธ APIType Read Priority ๊ธฐ๋Šฅ์ด
์ •์‹์œผ๋กœ ๋ฆด๋ฆฌ์ฆˆ ๋œ ๊ธฐ๋Šฅ ์ž…๋‹ˆ๋‹ค.
๊ทธ๋ž˜์„œ ๊ฐ‘์ž๊ธฐ ์—†์• ๋ฒ„๋ฆฌ๊ฑฐ๋‚˜ deprecated ์‹œํ‚ค๊ธฐ๋Š” ์ข€ ์• ๋งคํ•˜๋‹ค๊ณ  ์ƒ๊ฐ๋ฉ๋‹ˆ๋‹ค.
https://github.com/jam2in/arcus-works/issues/691#issuecomment-2661856525

๊ทธ๋ž˜์„œ API Type ์ด๋„˜์€ ์œ ์ง€๋ฅผ ํ•˜๊ณ  ์•ž์„  ์ฝ”๋ฉ˜ํŠธ ์ฒ˜๋Ÿผ
๊ตฌ์ฒด์ ์œผ๋กœ API Type์„ ๋ช…์‹œํ•ด์ฃผ๋Š”๊ฒŒ ์ข‹์„ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.

@jhpark816
Copy link
Collaborator

@brido4125 @oliviarla
api type์—์„œ operation type์„ ๋‚ดํฌํ•˜์ง€ ์•Š๋„๋ก ํ•˜๊ณ ,
api type๊ณผ operation type์„ ๋”ฐ๋กœ ์„ค์ •ํ•˜๋Š” ๊ฒƒ์ด ์ข‹์„ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.

@brido4125
Copy link
Collaborator Author

@jhpark816

์‚ดํŽด๋ณด๋‹ˆ APIType์ด OperationType์„ ๊ฐ€์ง€์ง€ ์•Š์„ ๊ฒฝ์šฐ ์•„๋ž˜ ๋ฌธ์ œ๊ฐ€ ์žˆ์—ˆ๋„ค์š”
์–ผ๋งˆ์ „์— ๊ณ ์นœ ReplicaPick ๊ตฌํ˜„์ž…๋‹ˆ๋‹ค.
Op ์ธ์Šคํ„ด์Šค๊ฐ€ ์ƒ์„ฑ๋˜๊ธฐ ์ „ ํ•ด๋‹ค ์—ฐ์‚ฐ์ด Read or Write์ธ์ง€
๊ตฌ๋ณ„ํ•˜๊ธฐ ์œ„ํ•ด APIType์„ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

์ด๋ ‡๊ฒŒ ๋  ๊ฒฝ์šฐ ํ˜„์žฌ ๊ตฌํ˜„๋Œ€๋กœ ์„œ๋กœ ๊ฒฐํ•ฉ๋œ ํ˜•ํƒœ๋ฅผ ๊ฐ€์ง€๋Š”๊ฒŒ ๋งž๋Š”๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.

private ReplicaPick getReplicaPick(APIType apiType) {
    ReplicaPick pick = ReplicaPick.MASTER;
    if (apiType.getAPIOpType() == OperationType.READ) {
      ReadPriority readPriority = connFactory.getAPIReadPriority().get(apiType);
      if (readPriority == null) {
        readPriority = connFactory.getReadPriority();
      }
      if (readPriority == ReadPriority.SLAVE) {
        pick = ReplicaPick.SLAVE;
      } else if (readPriority == ReadPriority.RR) {
        pick = ReplicaPick.RR;
      }
    }
    return pick;
  }

๊ทธ๋ž˜์„œ APIType๊ณผ OpType์ด ๊ฒฐํ•ฉ์ด ๋˜์–ด์•ผํ•œ๋‹ค๋ฉด
์•„๋ž˜ ์ฝ”๋ฉ˜ํŠธ๋ฅผ ์ ์šฉ์‹œํ‚ค๋Š”๊ฒŒ ์ข‹์„ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.
#879 (comment)

@jhpark816
Copy link
Collaborator

jhpark816 commented Feb 26, 2025

Op ์ธ์Šคํ„ด์Šค๊ฐ€ ์ƒ์„ฑ๋˜๊ธฐ ์ „ ํ•ด๋‹ค ์—ฐ์‚ฐ์ด Read or Write์ธ์ง€
๊ตฌ๋ณ„ํ•˜๊ธฐ ์œ„ํ•ด APIType์„ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

์–ด๋–ค ์—ฐ์‚ฐ์„ ์ƒ์„ฑํ•˜๋Š” ๋กœ์ง์ธ ์ง€ ๊ด€๋ จ ์ฝ”๋“œ๋ฅผ ์ œ์‹œํ•ด ์ฃผ์„ธ์š”.

@brido4125
Copy link
Collaborator Author

@jhpark816

XopBulkInsert์™€ ๊ฐ™์€ groupingKeys๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ์—ฐ์‚ฐ๋“ค์ž…๋‹ˆ๋‹ค.

@jhpark816
Copy link
Collaborator

@brido4125
groupingKeys(), getReplicaPick() ๋ฉ”์†Œ๋“œ์˜ ์ธํ„ฐํŽ˜์ด์Šค, ๋กœ์ง์„ ์ˆ˜์ •ํ•˜์—ฌ
ํ•ด๊ฒฐํ•˜๋Š” ๋ฐฉ์•ˆ์ด ์žˆ๋Š” ์ง€๋ฅผ ๊ฒ€ํ† ํ•ด ๋ณด์‹œ์ฃ .

@brido4125
Copy link
Collaborator Author

brido4125 commented Feb 27, 2025

@jhpark816

APIType๊ณผ OpType์„ ๋ถ„๋ฆฌํ•œ๋‹ค๋Š” ๊ฐ€์ •ํ•˜์—์„œ
์•„๋ž˜์™€ ๊ฐ™์ด ์ธ์ž๋กœ APIType๊ณผ OpType์„ ํ•จ๊ป˜ ๋‘๋Š” ๋ฐฉ์•ˆ ์ •๋„๊ฐ€ ๊ฐ€๋Šฅํ•œ ๋ฐฉ์•ˆ์ธ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.
(์•„๋‹ˆ๋ฉด TypeClass๋ฅผ ๋‘ฌ์„œ ๋‘ ๊ฐ€์ง€๋ฅผ ํ•œ ๊ฐ์ฒด์— ๋„ฃ์–ด์„œ ์‚ฌ์šฉํ•˜๋Š” ๋ฐฉ์•ˆ๋„ ์กด์žฌ)

private ReplicaPick getReplicaPick(APIType apiType, OperationType opType) {
    ReplicaPick pick = ReplicaPick.MASTER;
    if (opType == OperationType.READ) {
      ReadPriority readPriority = connFactory.getAPIReadPriority().get(apiType);
      if (readPriority == null) {
        readPriority = connFactory.getReadPriority();
      }
      if (readPriority == ReadPriority.SLAVE) {
        pick = ReplicaPick.SLAVE;
      } else if (readPriority == ReadPriority.RR) {
        pick = ReplicaPick.RR;
      }
    }
    return pick;
  }

ํŠนํžˆ groupingKeys ๊ตฌํ˜„์ด ํ˜„์žฌ๋ณด๋‹ค ์ข€ ์ง€์ €๋ถ„ํ•ด์ง€๋Š” ๋Š๋‚Œ์ด ์žˆ๊ธดํ•œ๋ฐ,
๋ง์”€ํ•˜์‹ ๋Œ€๋กœ APIType์˜ ๊ฐ€์ง“์ˆ˜๋ฅผ ๋Š˜๋ฆฌ๋Š” ๋ฐฉ์•ˆ๋ณด๋‹ค๋Š” ์ข‹์€ ๊ตฌํ˜„์ธ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.

@oliviarla
Copy link
Collaborator

@jhpark816 @brido4125
api type๊ณผ operation type์„ ๋”ฐ๋กœ ์„ค์ •ํ•˜๊ฒŒ ๋˜๋ฉด, ๊ฐ•์ œ์„ฑ์ด ์—†์–ด์ ธ getReplicaPick(LOP_INSERT, OperationType.READ) ๊ณผ ๊ฐ™์ด ํ˜ธ์ถœ์ด ๊ฐ€๋Šฅํ•ด์ง‘๋‹ˆ๋‹ค.

๋ฌผ๋ก  private ๋ฉ”์„œ๋“œ์ด๊ธฐ ๋•Œ๋ฌธ์— ์ €ํฌ๊ฐ€ ์‹ ๊ฒฝ์จ์„œ ๊ตฌํ˜„ํ•˜๋ฉด ๋˜์ง€๋งŒ, ํ˜ผ๋ˆ์„ ๋ง‰๊ณ  ๊ฐ•์ œ์„ฑ์„ ๋ถ€์—ฌํ•˜๊ธฐ ์œ„ํ•ด ApiType๊ณผ OperationType์€ ๊ฒฐํ•ฉ๋œ ํ˜•ํƒœ๋กœ ๋‘๋Š”๊ฒŒ ๋‚˜์„ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants