Skip to content
Snippets Groups Projects
  • Fakai Zhao's avatar
    de839fc3
    optimize srv broker and executor logic (#630) · de839fc3
    Fakai Zhao authored
    
    ### What problem does this PR solve?
    
    Optimize task broker and executor for reduce memory usage and deployment
    complexity.
    
    ### Type of change
    - [x] Performance Improvement
    - [x] Refactoring
    
    ### Change Log
    - Enhance redis utils for message queue(use stream)
    - Modify task broker logic via message queue (1.get parse event from
    message queue 2.use ThreadPoolExecutor async executor )
    - Modify the table column name of document and task (process_duation ->
    process_duration maybe just a spelling mistake)
    - Reformat some code style(just what i see)
    - Add requirement_dev.txt for developer
    - Add redis container on docker compose
    
    ---------
    
    Co-authored-by: default avatarKevin Hu <kevinhu.sh@gmail.com>
    optimize srv broker and executor logic (#630)
    Fakai Zhao authored
    
    ### What problem does this PR solve?
    
    Optimize task broker and executor for reduce memory usage and deployment
    complexity.
    
    ### Type of change
    - [x] Performance Improvement
    - [x] Refactoring
    
    ### Change Log
    - Enhance redis utils for message queue(use stream)
    - Modify task broker logic via message queue (1.get parse event from
    message queue 2.use ThreadPoolExecutor async executor )
    - Modify the table column name of document and task (process_duation ->
    process_duration maybe just a spelling mistake)
    - Reformat some code style(just what i see)
    - Add requirement_dev.txt for developer
    - Add redis container on docker compose
    
    ---------
    
    Co-authored-by: default avatarKevin Hu <kevinhu.sh@gmail.com>
Code owners
Assign users and groups as approvers for specific file changes. Learn more.