incubator-doris [Transaction] FE will not cancel some stream load txn when the stream load cannot be finished

rryofs0p  于 2022-04-22  发布在  Java
关注(0)|答案(0)|浏览(102)

In current StreamLoad design, FE will recive load information from BE by RPC call, but I found that if the coordinator BE down when doing stream load fragment, FE will not receive any rollback txn call and the txns on the coordinator BE will never finished and the state is always PREPARE, it is because FE has no idea that the txn will aborted finally cause the fragment execute failed, and be cann't notify FE that case. So, if user set a long timeout stream load in parameters, there are a lots txns in GlobalTxnMgr, and they occupied the txn queue sizes and memory usage in FE, it may block the stream load.So, I define a callback function to cancel all txn which coordiator BE is down to solve this problem

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题