本文整理了Java中com.dremio.exec.ops.QueryContext.getActiveEndpoints
方法的一些代码示例,展示了QueryContext.getActiveEndpoints
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。QueryContext.getActiveEndpoints
方法的具体详情如下:
包路径:com.dremio.exec.ops.QueryContext
类名称:QueryContext
方法名:getActiveEndpoints
暂无
代码示例来源:origin: dremio/dremio-oss
public SimpleParallelizer(QueryContext context, AttemptObserver observer, Collection<NodeEndpoint> activeEndpoints) {
this.queryContext = context;
OptionManager optionManager = context.getOptions();
long sliceTarget = context.getPlannerSettings().getSliceTarget();
this.parallelizationThreshold = sliceTarget > 0 ? sliceTarget : 1;
final long configuredMaxWidthPerNode = context.getClusterResourceInformation().getAverageExecutorCores(optionManager);
final double maxWidthFactor = context.getWorkStatsProvider().get().getMaxWidthFactor();
this.maxWidthPerNode = (int) Math.max(1, configuredMaxWidthPerNode * maxWidthFactor);
if (logger.isDebugEnabled() && maxWidthFactor < 1) {
final float clusterLoad = context.getWorkStatsProvider().get().getClusterLoad();
logger.debug("Cluster load {} exceeded cutoff, max_width_factor = {}. current max_width = {}",
clusterLoad, maxWidthFactor, this.maxWidthPerNode);
}
this.executionMap = new ExecutionNodeMap(Optional.ofNullable(activeEndpoints).orElse(context.getActiveEndpoints()));
this.maxGlobalWidth = (int) optionManager.getOption(ExecConstants.MAX_WIDTH_GLOBAL);
this.affinityFactor = optionManager.getOption(ExecConstants.AFFINITY_FACTOR);
this.useNewAssignmentCreator = !optionManager.getOption(ExecConstants.OLD_ASSIGNMENT_CREATOR);
this.assignmentCreatorBalanceFactor = optionManager.getOption(ExecConstants.ASSIGNMENT_CREATOR_BALANCE_FACTOR);
this.observer = observer;
this.fragmentCodec = FragmentCodec.valueOf(optionManager.getOption(ExecConstants.FRAGMENT_CODEC).toUpperCase());
}
代码示例来源:origin: dremio/dremio-oss
final double planCost = plan.getCost();
setQueueTypeFromPlan(plan);
final Collection<CoordinationProtos.NodeEndpoint> activeEndpoints = context.getActiveEndpoints();
final PlanningSet planningSet = ExecutionPlanCreator.getParallelizationInfo(context, observer, plan,
activeEndpoints);
代码示例来源:origin: dremio/dremio-oss
protected QueryContext mockQueryContext(SabotContext dbContext) throws Exception {
final UserSession userSession = UserSession.Builder.newBuilder().withOptionManager(dbContext.getOptionManager()).build();
final SessionOptionManager sessionOptions = (SessionOptionManager) userSession.getOptions();
final QueryOptionManager queryOptions = new QueryOptionManager(sessionOptions);
final ExecutionControls executionControls = new ExecutionControls(queryOptions, NodeEndpoint.getDefaultInstance());
final OperatorTable table = new OperatorTable(FUNCTIONS());
final LogicalPlanPersistence lp = dbContext.getLpPersistence();
final CatalogService registry = dbContext.getCatalogService();
final QueryContext context = Mockito.mock(QueryContext.class);
when(context.getSession()).thenReturn(userSession);
when(context.getLpPersistence()).thenReturn(lp);
when(context.getCatalogService()).thenReturn(registry);
when(context.getFunctionRegistry()).thenReturn(FUNCTIONS());
when(context.getSession()).thenReturn(UserSession.Builder.newBuilder().setSupportComplexTypes(true).build());
when(context.getCurrentEndpoint()).thenReturn(NodeEndpoint.getDefaultInstance());
when(context.getActiveEndpoints()).thenReturn(ImmutableList.of(NodeEndpoint.getDefaultInstance()));
when(context.getPlannerSettings()).thenReturn(new PlannerSettings(dbContext.getConfig(), queryOptions, dbContext.getClusterResourceInformation()));
when(context.getOptions()).thenReturn(queryOptions);
when(context.getConfig()).thenReturn(DEFAULT_SABOT_CONFIG);
when(context.getOperatorTable()).thenReturn(table);
when(context.getAllocator()).thenReturn(allocator);
when(context.getExecutionControls()).thenReturn(executionControls);
when(context.getMaterializationProvider()).thenReturn(Mockito.mock(MaterializationDescriptorProvider.class));
return context;
}
代码示例来源:origin: dremio/dremio-oss
Collection<NodeEndpoint> endpoints = queryContext.getActiveEndpoints();
if(endpoints.isEmpty()){
throw UserException.resourceError().message("No executors currently available.").build(logger);
代码示例来源:origin: dremio/dremio-oss
final Collection<NodeEndpoint> currentActiveAllocationEndpoints = intersectEndpoints(currentAllocationEndpoints, queryContext.getActiveEndpoints());
内容来源于网络,如有侵权,请联系作者删除!