#include "config.h"#include "system.h"#include "coretypes.h"#include "backend.h"#include "rtl.h"#include "tree.h"#include "predict.h"#include "df.h"#include "insn-config.h"#include "regs.h"#include "memmodel.h"#include "ira.h"#include "ira-int.h"#include "cfgrtl.h"#include "cfgbuild.h"#include "expr.h"#include "reload.h"#include "cfgloop.h"
Data Structures | |
| struct | move |
Typedefs | |
| typedef void * | void_p |
| typedef struct move * | move_t |
Typedef Documentation
◆ move_t
◆ void_p
Function Documentation
◆ add_range_and_copies_from_move_list()
|
static |
Process moves from LIST with execution FREQ to add ranges, copies, and modify costs for allocnos involved in the moves. All regnos living through the list is in LIVE_THROUGH, and the loop tree node used to find corresponding allocnos is NODE.
References a, ALLOCNO_EMIT_DATA, allocno_emit_reg(), ALLOCNO_NUM, ALLOCNO_NUM_OBJECTS, ALLOCNO_OBJECT, ALLOCNO_REGNO, bitmap_clear_bit(), EXECUTE_IF_SET_IN_BITMAP, move::from, ggc_alloc(), hard_regs_live, i, move::insn, internal_flag_ira_verbose, ior_hard_reg_conflicts(), ira_add_allocno_copy(), ira_add_live_range_to_object(), ira_allocate_object_conflicts(), ira_dump_file, ira_max_point, move::next, nr, NULL, OBJECT_CONFLICT_ARRAY, OBJECT_LIVE_RANGES, r, REG_SET_TO_HARD_REG_SET, REGNO, ira_loop_tree_node::regno_allocno_map, move::to, and update_costs().
Referenced by add_ranges_and_copies().
◆ add_ranges_and_copies()
Process all move list to add ranges, conflicts, copies, and modify costs for allocnos involved in the moves.
References add_range_and_copies_from_move_list(), at_bb_end, at_bb_start, bitmap_and(), bitmap_copy(), cfun, df_get_live_in(), df_get_live_out(), EDGE_FREQUENCY, FOR_EACH_BB_FN, FOR_EACH_EDGE, ggc_alloc(), basic_block_def::index, ira_allocate_bitmap(), IRA_BB_NODE, ira_free_bitmap(), ira_loop_tree_node::parent, REG_FREQ_FROM_BB, REG_FREQ_FROM_EDGE_FREQ, and basic_block_def::succs.
Referenced by ira_emit().
◆ add_to_edge_list()
Attach MOVE to the edge E. The move is attached to the head of the list if HEAD_P is TRUE.
References ggc_alloc(), last, filedep::next, move::next, and NULL.
Referenced by generate_edge_moves().
◆ change_loop()
|
static |
Change (if necessary) pseudo-registers inside loop given by loop tree node NODE.
References ira_loop_tree_node::all_allocnos, ALLOCNO_CAP_MEMBER, ALLOCNO_CLASS, ALLOCNO_EMIT_DATA, allocno_emit_reg(), ALLOCNO_HARD_REGNO, ALLOCNO_MODE, ALLOCNO_REGNO, ira_loop_tree_node::bb, bitmap_and_compl(), bitmap_set_bit, ira_loop_tree_node::border_allocnos, change_regs_in_insn(), current_loops, df_insn_rescan(), df_notes_rescan(), EXECUTE_IF_SET_IN_REG_SET, FOR_BB_INSNS, ggc_alloc(), loop::header, i, basic_block_def::index, INSN_P, internal_flag_ira_verbose, ira_allocnos, ira_assert, ira_class_hard_regs_num, ira_create_new_reg(), ira_curr_loop_tree_node, ira_dump_file, ira_equiv_no_lvalue_p(), ira_loop_tree_root, ira_pressure_class_translate, ira_prohibited_mode_move_regs, ira_reg_equiv_len, local_allocno_bitmap, ira_loop_tree_node::loop, ira_loop_tree_node::loop_num, map, NULL, ira_loop_tree_node::parent, pic_offset_table_rtx, ira_loop_tree_node::reg_pressure, REGNO, ira_loop_tree_node::regno_allocno_map, renamed_regno_bitmap, set_allocno_reg(), TEST_HARD_REG_BIT, and used_regno_bitmap.
Referenced by ira_emit().
◆ change_regs()
This recursive function changes pseudo-registers in *LOC if it is necessary. The function returns TRUE if a change was done.
References allocno_emit_reg(), change_regs(), GET_CODE, GET_RTX_FORMAT, GET_RTX_LENGTH, ggc_alloc(), i, ira_curr_regno_allocno_map, max_regno_before_changing, NULL, NULL_RTX, REGNO, XEXP, XVECEXP, and XVECLEN.
Referenced by change_regs(), and change_regs_in_insn().
◆ change_regs_in_insn()
References change_regs(), and ggc_alloc().
Referenced by change_loop().
◆ create_move()
|
static |
Return new move of allocnos TO and FROM.
References move::deps, move::deps_num, move::from, move::insn, ira_allocate(), move::next, NULL, move::to, and move::visited_p.
Referenced by generate_edge_moves(), and modify_move_list().
◆ create_new_allocno()
|
static |
Create and return a new allocno with given REGNO and LOOP_TREE_NODE. Allocate emit data for it.
References a, ALLOCNO_ADD_DATA, ggc_alloc(), ira_allocate(), ira_create_allocno(), and new_allocno_emit_data_vec.
Referenced by modify_move_list().
◆ emit_move_list()
Generate RTX move insns from the move list LIST. This updates allocation cost using move execution frequency FREQ.
References ALLOCNO_CLASS, allocno_emit_reg(), ALLOCNO_HARD_REGNO, ALLOCNO_MODE, emit_insn(), emit_move_insn(), end_sequence(), move::from, gen_rtx_INSN_LIST(), GET_CODE, get_insns(), ggc_alloc(), grow_reg_equivs(), move::insn, ira_assert, ira_init_register_move_cost_if_necessary(), ira_load_cost, ira_memory_move_cost, ira_overall_cost, ira_reg_equiv, ira_reg_equiv_len, ira_register_move_cost, ira_shuffle_cost, ira_store_cost, ira_update_equiv_info_by_shuffle_insn(), ira_use_lra_p, move::next, NEXT_INSN(), NULL, NULL_RTX, recog_memoized(), reg_equiv_init, reg_equivs, REG_P, REGNO, SET_DEST, single_set(), start_sequence(), SUBREG_REG, and move::to.
Referenced by emit_moves().
◆ emit_moves()
Generate RTX move insns from move lists attached to basic blocks and edges.
References at_bb_end, at_bb_start, BB_END, BB_HEAD, cfun, control_flow_insn_p(), EDGE_CRITICAL_P, EDGE_FREQUENCY, emit_insn_after(), emit_insn_before(), emit_move_list(), FOR_EACH_BB_FN, FOR_EACH_EDGE, get_last_insn(), ggc_alloc(), basic_block_def::index, insert_insn_on_edge(), INSN_LOCATION(), insns, ira_additional_jumps_num, ira_assert, LABEL_P, modify_move_list(), NEXT_INSN(), NONDEBUG_INSN_P, NOTE_INSN_BASIC_BLOCK_P, NULL, PREV_INSN(), REG_FREQ_FROM_BB, REG_FREQ_FROM_EDGE_FREQ, set_insn_locations(), and basic_block_def::succs.
Referenced by ira_emit().
◆ entered_from_non_parent_p()
|
static |
Return true if there is an entry to given loop not from its parent (or grandparent) block. For example, it is possible for two adjacent loops inside another loop.
References cfun, ENTRY_BLOCK_PTR_FOR_FN, FOR_EACH_EDGE, ggc_alloc(), IRA_BB_NODE, NULL, and ira_loop_tree_node::parent.
Referenced by setup_entered_from_non_parent_p().
◆ eq_edge_move_lists_p()
Return TRUE if move lists on all edges given in vector VEC are equal.
References EDGE_COUNT, EDGE_I, eq_move_lists_p(), and i.
Referenced by unify_moves().
◆ eq_move_lists_p()
Return TRUE if the move list LIST1 and LIST2 are equal (two moves are equal if they involve the same allocnos).
References ggc_alloc(), and NULL.
Referenced by eq_edge_move_lists_p().
◆ free_move()
Free memory for MOVE and its dependencies.
References move::deps, ira_free(), and NULL.
Referenced by free_move_list().
◆ free_move_list()
Free memory for list of the moves given by its HEAD.
References free_move(), and NULL.
Referenced by ira_emit(), and unify_moves().
◆ generate_edge_moves()
Generate and attach moves to the edge E. This looks at the final regnos of allocnos living on the edge with the same original regno to figure out when moves should be generated.
References add_to_edge_list(), ALLOCNO_EMIT_DATA, allocno_emit_reg(), ALLOCNO_HARD_REGNO, ALLOCNO_NUM, bitmap_bit_p, create_move(), df_get_live_in(), df_get_live_out(), EXECUTE_IF_SET_IN_REG_SET, ggc_alloc(), internal_flag_ira_verbose, IRA_BB_NODE, ira_dump_file, NULL, REGNO, and store_can_be_removed_p().
Referenced by ira_emit().
◆ ira_create_new_reg()
Create and return new pseudo-register with the same attributes as ORIGINAL_REG.
References gen_reg_rtx(), GET_MODE, ggc_alloc(), internal_flag_ira_verbose, ira_dump_file, ira_expand_reg_equiv(), NULL, ORIGINAL_REGNO, REG_ATTRS, REG_POINTER, REG_USERVAR_P, and REGNO.
Referenced by change_loop(), find_moveable_pseudos(), modify_move_list(), and split_live_ranges_for_shrink_wrap().
◆ ira_debug_move_list()
Print move list LIST into stderr.
References ggc_alloc(), and print_move_list().
◆ ira_emit()
The entry function changes code and generates shuffling allocnos on region borders for the regional (LOOPS_P is TRUE in this case) register allocation.
References a, add_ranges_and_copies(), ALLOCNO_EMIT_DATA, allocno_last_set, allocno_last_set_check, ALLOCNO_REGNO, at_bb_end, at_bb_start, cfun, change_loop(), commit_edge_insertions(), curr_tick, emit_moves(), EXIT_BLOCK_PTR_FOR_FN, FOR_BB_INSNS_REVERSE, FOR_EACH_ALLOCNO, FOR_EACH_BB_FN, FOR_EACH_EDGE, free_move_list(), generate_edge_moves(), ggc_alloc(), hard_regno_last_set_check, basic_block_def::index, INSN_P, ira_allocate(), ira_allocate_bitmap(), ira_allocnos_num, ira_free(), ira_free_bitmap(), ira_loop_tree_root, ira_traverse_loop_tree(), last_basic_block_for_fn, local_allocno_bitmap, max_reg_num(), max_regno_before_changing, move_vec, NULL, recog_memoized(), regno_reg_rtx, renamed_regno_bitmap, set_allocno_somewhere_renamed_p(), setup_entered_from_non_parent_p(), basic_block_def::succs, unify_moves(), and used_regno_bitmap.
Referenced by ira().
◆ ira_finish_emit_data()
Free the emit data.
References a, ALLOCNO_ADD_DATA, FOR_EACH_ALLOCNO, ggc_alloc(), ira_allocno_emit_data, ira_free(), new_allocno_emit_data_vec, and NULL.
Referenced by ira().
◆ ira_initiate_emit_data()
Allocate and initiate the emit data.
References a, ALLOCNO_ADD_DATA, ALLOCNO_NUM, FOR_EACH_ALLOCNO, ggc_alloc(), ira_allocate(), ira_allocno_emit_data, ira_allocnos_num, and new_allocno_emit_data_vec.
Referenced by ira().
◆ modify_move_list()
Remove unnecessary moves in the LIST, makes topological sorting, and removes cycles on hard reg dependencies by introducing new allocnos assigned to memory and additional moves. It returns the result move list.
References ALLOCNO_ASSIGNED_P, ALLOCNO_CLASS, ALLOCNO_EMIT_DATA, allocno_emit_reg(), ALLOCNO_HARD_REGNO, ALLOCNO_LOOP_TREE_NODE, ALLOCNO_MODE, ALLOCNO_NUM, ALLOCNO_NUM_OBJECTS, ALLOCNO_OBJECT, ALLOCNO_REGNO, create_move(), create_new_allocno(), curr_tick, move::deps, move::deps_num, move::from, gcc_assert, ggc_alloc(), hard_regno_last_set, hard_regno_last_set_check, hard_regno_nregs(), i, internal_flag_ira_verbose, ira_allocate(), ira_create_allocno_objects(), ira_create_new_reg(), ira_dump_file, ira_move_loops_num, ira_objects_num, ira_set_allocno_class(), last, move_vec, filedep::next, move::next, NULL, OBJECT_MAX, OBJECT_MIN, REGNO, move::to, and traverse_moves().
Referenced by emit_moves().
◆ print_move_list()
Print move list LIST into file F.
References ALLOCNO_NUM, ALLOCNO_REGNO, move::from, ggc_alloc(), move::next, NULL, and move::to.
Referenced by ira_debug_move_list().
◆ set_allocno_reg()
|
static |
Set up member `reg' to REG for allocnos which has the same regno as ALLOCNO and which are inside the loop corresponding to ALLOCNO.
References a, ALLOCNO_CAP, ALLOCNO_EMIT_DATA, ALLOCNO_LOOP_TREE_NODE, ALLOCNO_NEXT_REGNO_ALLOCNO, ALLOCNO_REGNO, ira_regno_allocno_map, NULL, ira_loop_tree_node::parent, ira_loop_tree_node::regno_allocno_map, and subloop_tree_node_p().
Referenced by change_loop().
◆ set_allocno_somewhere_renamed_p()
Process to set up flag somewhere_renamed_p.
References ALLOCNO_EMIT_DATA, allocno_emit_reg(), ALLOCNO_REGNO, bitmap_bit_p, FOR_EACH_ALLOCNO, ggc_alloc(), REGNO, and renamed_regno_bitmap.
Referenced by ira_emit().
◆ setup_entered_from_non_parent_p()
Set up ENTERED_FROM_NON_PARENT_P for each loop region.
References cfun, current_loops, entered_from_non_parent_p(), ira_loop_tree_node::entered_from_non_parent_p, FOR_EACH_VEC_SAFE_ELT, get_loops(), i, ira_assert, ira_loop_nodes, and NULL.
Referenced by ira_emit().
◆ store_can_be_removed_p()
|
static |
Return TRUE if move of SRC_ALLOCNO (assigned to hard register) to DEST_ALLOCNO (assigned to memory) can be removed because it does not change value of the destination. One possible reason for this is the situation when SRC_ALLOCNO is not modified in the corresponding loop.
References a, ALLOCNO_CAP_MEMBER, allocno_emit_reg(), ALLOCNO_LOOP_TREE_NODE, ALLOCNO_REGNO, bitmap_bit_p, ira_loop_tree_node::entered_from_non_parent_p, ggc_alloc(), ira_assert, ira_loop_tree_node::modified_regnos, NULL, ira_loop_tree_node::parent, REGNO, and ira_loop_tree_node::regno_allocno_map.
Referenced by generate_edge_moves().
◆ subloop_tree_node_p()
|
static |
Return TRUE if loop given by SUBNODE inside the loop given by NODE.
References ggc_alloc(), and NULL.
Referenced by set_allocno_reg().
◆ traverse_moves()
This recursive function traverses dependencies of MOVE and produces topological sorting (in depth-first order).
References move::deps, move::deps_num, i, move_vec, traverse_moves(), and move::visited_p.
Referenced by modify_move_list(), and traverse_moves().
◆ unify_moves()
|
static |
Look at all entry edges (if START_P) or exit edges of basic block BB and put move lists at the BB start or end if it is possible. In other words, this decreases code duplication of allocno moves.
References at_bb_end, at_bb_start, BB_END, control_flow_insn_p(), EDGE_COUNT, EDGE_I, eq_edge_move_lists_p(), free_move_list(), ggc_alloc(), i, basic_block_def::index, NULL, basic_block_def::preds, and basic_block_def::succs.
Referenced by ira_emit().
◆ update_costs()
|
static |
Update costs of A and corresponding allocnos on upper levels on the loop tree from reading (if READ_P) or writing A on an execution path with FREQ.
References a, ALLOCNO_CAP, ALLOCNO_CLASS, ALLOCNO_FREQ, ALLOCNO_LOOP_TREE_NODE, ALLOCNO_MEMORY_COST, ALLOCNO_MODE, ALLOCNO_NREFS, ALLOCNO_REGNO, ggc_alloc(), ira_memory_move_cost, NULL, and ira_loop_tree_node::regno_allocno_map.
Referenced by add_range_and_copies_from_move_list().
Variable Documentation
◆ allocno_last_set
|
static |
Last move (in move sequence being processed) setting up the corresponding allocno.
Referenced by ira_emit().
◆ allocno_last_set_check
|
static |
If the element value is equal to CURR_TICK then the corresponding element in . `allocno_last_set' is defined and correct.
Referenced by ira_emit().
◆ at_bb_end
|
static |
Referenced by add_ranges_and_copies(), emit_moves(), ira_emit(), and unify_moves().
◆ at_bb_start
|
static |
Array of moves (indexed by BB index) which should be put at the start/end of the corresponding basic blocks.
Referenced by add_ranges_and_copies(), emit_moves(), ira_emit(), and unify_moves().
◆ curr_tick
|
static |
The variable value is used to check correctness of values of elements of arrays `hard_regno_last_set' and `allocno_last_set_check'.
Referenced by ira_emit(), and modify_move_list().
◆ hard_regno_last_set
|
static |
Last move (in move sequence being processed) setting up the corresponding hard register.
Referenced by modify_move_list().
◆ hard_regno_last_set_check
|
static |
If the element value is equal to CURR_TICK then the corresponding element in `hard_regno_last_set' is defined and correct.
Referenced by ira_emit(), and modify_move_list().
◆ ira_allocno_emit_data
| ira_emit_data_t ira_allocno_emit_data |
Integrated Register Allocator. Changing code and generating moves. Copyright (C) 2006-2024 Free Software Foundation, Inc. Contributed by Vladimir Makarov <vmakarov@redhat.com>. This file is part of GCC. GCC is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 3, or (at your option) any later version. GCC is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with GCC; see the file COPYING3. If not see <http://www.gnu.org/licenses/>.
When we have more one region, we need to change the original RTL code after coloring. Let us consider two allocnos representing the same pseudo-register outside and inside a region respectively. They can get different hard-registers. The reload pass works on pseudo registers basis and there is no way to say the reload that pseudo could be in different registers and it is even more difficult to say in what places of the code the pseudo should have particular hard-registers. So in this case IRA has to create and use a new pseudo-register inside the region and adds code to move allocno values on the region's borders. This is done by the code in this file. The code makes top-down traversal of the regions and generate new pseudos and the move code on the region borders. In some complicated cases IRA can create a new pseudo used temporarily to move allocno values when a swap of values stored in two hard-registers is needed (e.g. two allocnos representing different pseudos outside region got respectively hard registers 1 and 2 and the corresponding allocnos inside the region got respectively hard registers 2 and 1). At this stage, the new pseudo is marked as spilled. IRA still creates the pseudo-register and the moves on the region borders even when the both corresponding allocnos were assigned to the same hard-register. It is done because, if the reload pass for some reason spills a pseudo-register representing the original pseudo outside or inside the region, the effect will be smaller because another pseudo will still be in the hard-register. In most cases, this is better then spilling the original pseudo in its whole live-range. If reload does not change the allocation for the two pseudo-registers, the trivial move will be removed by post-reload optimizations. IRA does not generate a new pseudo and moves for the allocno values if the both allocnos representing an original pseudo inside and outside region assigned to the same hard register when the register pressure in the region for the corresponding pressure class is less than number of available hard registers for given pressure class. IRA also does some optimizations to remove redundant moves which is transformed into stores by the reload pass on CFG edges representing exits from the region. IRA tries to reduce duplication of code generated on CFG edges which are enters and exits to/from regions by moving some code to the edge sources or destinations when it is possible.
Data used to emit live range split insns and to flattening IR.
Referenced by ira_finish_emit_data(), and ira_initiate_emit_data().
◆ local_allocno_bitmap
|
static |
Bitmap of allocnos local for the current loop.
Referenced by change_loop(), and ira_emit().
◆ max_regno_before_changing
|
static |
Max regno before renaming some pseudo-registers. For example, the same pseudo-register can be renamed in a loop if its allocation is different outside the loop.
Referenced by change_regs(), and ira_emit().
◆ move_vec
Definition of vector of moves.
This vec contains moves sorted topologically (depth-first) on their dependency graph.
Referenced by ira_emit(), modify_move_list(), and traverse_moves().
◆ new_allocno_emit_data_vec
Pointers to data allocated for allocnos being created during emitting. Usually there are quite few such allocnos because they are created only for resolving loop in register shuffling.
Referenced by create_new_allocno(), ira_finish_emit_data(), and ira_initiate_emit_data().
◆ renamed_regno_bitmap
|
static |
This bitmap contains regnos of allocnos which were renamed locally because the allocnos correspond to disjoint live ranges in loops with a common parent.
Referenced by change_loop(), ira_emit(), and set_allocno_somewhere_renamed_p().
◆ used_regno_bitmap
|
static |
This bitmap is used to find that we need to generate and to use a new pseudo-register when processing allocnos with the same original regno.
Referenced by change_loop(), and ira_emit().
