projects / deliverable / binutils-gdb.git / blob
? search:


c9e3a559bc30ca29ddddda75cb2d55b0d4eb51d8
[deliverable/binutils-gdb.git] / bfd / elfnn-aarch64.c
1 /* AArch64-specific support for NN-bit ELF.
2 Copyright (C) 2009-2015 Free Software Foundation, Inc.
3 Contributed by ARM Ltd.
4
5 This file is part of BFD, the Binary File Descriptor library.
6
7 This program is free software; you can redistribute it and/or modify
8 it under the terms of the GNU General Public License as published by
9 the Free Software Foundation; either version 3 of the License, or
10 (at your option) any later version.
11
12 This program is distributed in the hope that it will be useful,
13 but WITHOUT ANY WARRANTY; without even the implied warranty of
14 MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
15 GNU General Public License for more details.
16
17 You should have received a copy of the GNU General Public License
18 along with this program; see the file COPYING3. If not,
19 see <http://www.gnu.org/licenses/>. */
20
21 /* Notes on implementation:
22
23 Thread Local Store (TLS)
24
25 Overview:
26
27 The implementation currently supports both traditional TLS and TLS
28 descriptors, but only general dynamic (GD).
29
30 For traditional TLS the assembler will present us with code
31 fragments of the form:
32
33 adrp x0, :tlsgd:foo
34 R_AARCH64_TLSGD_ADR_PAGE21(foo)
35 add x0, :tlsgd_lo12:foo
36 R_AARCH64_TLSGD_ADD_LO12_NC(foo)
37 bl __tls_get_addr
38 nop
39
40 For TLS descriptors the assembler will present us with code
41 fragments of the form:
42
43 adrp x0, :tlsdesc:foo R_AARCH64_TLSDESC_ADR_PAGE21(foo)
44 ldr x1, [x0, #:tlsdesc_lo12:foo] R_AARCH64_TLSDESC_LD64_LO12(foo)
45 add x0, x0, #:tlsdesc_lo12:foo R_AARCH64_TLSDESC_ADD_LO12(foo)
46 .tlsdesccall foo
47 blr x1 R_AARCH64_TLSDESC_CALL(foo)
48
49 The relocations R_AARCH64_TLSGD_{ADR_PREL21,ADD_LO12_NC} against foo
50 indicate that foo is thread local and should be accessed via the
51 traditional TLS mechanims.
52
53 The relocations R_AARCH64_TLSDESC_{ADR_PAGE21,LD64_LO12_NC,ADD_LO12_NC}
54 against foo indicate that 'foo' is thread local and should be accessed
55 via a TLS descriptor mechanism.
56
57 The precise instruction sequence is only relevant from the
58 perspective of linker relaxation which is currently not implemented.
59
60 The static linker must detect that 'foo' is a TLS object and
61 allocate a double GOT entry. The GOT entry must be created for both
62 global and local TLS symbols. Note that this is different to none
63 TLS local objects which do not need a GOT entry.
64
65 In the traditional TLS mechanism, the double GOT entry is used to
66 provide the tls_index structure, containing module and offset
67 entries. The static linker places the relocation R_AARCH64_TLS_DTPMOD
68 on the module entry. The loader will subsequently fixup this
69 relocation with the module identity.
70
71 For global traditional TLS symbols the static linker places an
72 R_AARCH64_TLS_DTPREL relocation on the offset entry. The loader
73 will subsequently fixup the offset. For local TLS symbols the static
74 linker fixes up offset.
75
76 In the TLS descriptor mechanism the double GOT entry is used to
77 provide the descriptor. The static linker places the relocation
78 R_AARCH64_TLSDESC on the first GOT slot. The loader will
79 subsequently fix this up.
80
81 Implementation:
82
83 The handling of TLS symbols is implemented across a number of
84 different backend functions. The following is a top level view of
85 what processing is performed where.
86
87 The TLS implementation maintains state information for each TLS
88 symbol. The state information for local and global symbols is kept
89 in different places. Global symbols use generic BFD structures while
90 local symbols use backend specific structures that are allocated and
91 maintained entirely by the backend.
92
93 The flow:
94
95 elfNN_aarch64_check_relocs()
96
97 This function is invoked for each relocation.
98
99 The TLS relocations R_AARCH64_TLSGD_{ADR_PREL21,ADD_LO12_NC} and
100 R_AARCH64_TLSDESC_{ADR_PAGE21,LD64_LO12_NC,ADD_LO12_NC} are
101 spotted. One time creation of local symbol data structures are
102 created when the first local symbol is seen.
103
104 The reference count for a symbol is incremented. The GOT type for
105 each symbol is marked as general dynamic.
106
107 elfNN_aarch64_allocate_dynrelocs ()
108
109 For each global with positive reference count we allocate a double
110 GOT slot. For a traditional TLS symbol we allocate space for two
111 relocation entries on the GOT, for a TLS descriptor symbol we
112 allocate space for one relocation on the slot. Record the GOT offset
113 for this symbol.
114
115 elfNN_aarch64_size_dynamic_sections ()
116
117 Iterate all input BFDS, look for in the local symbol data structure
118 constructed earlier for local TLS symbols and allocate them double
119 GOT slots along with space for a single GOT relocation. Update the
120 local symbol structure to record the GOT offset allocated.
121
122 elfNN_aarch64_relocate_section ()
123
124 Calls elfNN_aarch64_final_link_relocate ()
125
126 Emit the relevant TLS relocations against the GOT for each TLS
127 symbol. For local TLS symbols emit the GOT offset directly. The GOT
128 relocations are emitted once the first time a TLS symbol is
129 encountered. The implementation uses the LSB of the GOT offset to
130 flag that the relevant GOT relocations for a symbol have been
131 emitted. All of the TLS code that uses the GOT offset needs to take
132 care to mask out this flag bit before using the offset.
133
134 elfNN_aarch64_final_link_relocate ()
135
136 Fixup the R_AARCH64_TLSGD_{ADR_PREL21, ADD_LO12_NC} relocations. */
137
138 #include "sysdep.h"
139 #include "bfd.h"
140 #include "libiberty.h"
141 #include "libbfd.h"
142 #include "bfd_stdint.h"
143 #include "elf-bfd.h"
144 #include "bfdlink.h"
145 #include "objalloc.h"
146 #include "elf/aarch64.h"
147 #include "elfxx-aarch64.h"
148
149 #define ARCH_SIZE NN
150
151 #if ARCH_SIZE == 64
152 #define AARCH64_R(NAME) R_AARCH64_ ## NAME
153 #define AARCH64_R_STR(NAME) "R_AARCH64_" #NAME
154 #define HOWTO64(...) HOWTO (__VA_ARGS__)
155 #define HOWTO32(...) EMPTY_HOWTO (0)
156 #define LOG_FILE_ALIGN 3
157 #endif
158
159 #if ARCH_SIZE == 32
160 #define AARCH64_R(NAME) R_AARCH64_P32_ ## NAME
161 #define AARCH64_R_STR(NAME) "R_AARCH64_P32_" #NAME
162 #define HOWTO64(...) EMPTY_HOWTO (0)
163 #define HOWTO32(...) HOWTO (__VA_ARGS__)
164 #define LOG_FILE_ALIGN 2
165 #endif
166
167 #define IS_AARCH64_TLS_RELOC(R_TYPE) \
168 ((R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21 \
169 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADR_PREL21 \
170 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC \
171 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1 \
172 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC \
173 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21 \
174 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC \
175 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC \
176 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19 \
177 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12 \
178 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12 \
179 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC \
180 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2 \
181 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1 \
182 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC \
183 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0 \
184 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC \
185 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_DTPMOD \
186 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_DTPREL \
187 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_TPREL \
188 || IS_AARCH64_TLSDESC_RELOC ((R_TYPE)))
189
190 #define IS_AARCH64_TLSDESC_RELOC(R_TYPE) \
191 ((R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD_PREL19 \
192 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21 \
193 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21 \
194 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC \
195 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC \
196 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC \
197 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_OFF_G1 \
198 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC \
199 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LDR \
200 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADD \
201 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_CALL \
202 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC)
203
204 #define ELIMINATE_COPY_RELOCS 0
205
206 /* Return size of a relocation entry. HTAB is the bfd's
207 elf_aarch64_link_hash_entry. */
208 #define RELOC_SIZE(HTAB) (sizeof (ElfNN_External_Rela))
209
210 /* GOT Entry size - 8 bytes in ELF64 and 4 bytes in ELF32. */
211 #define GOT_ENTRY_SIZE (ARCH_SIZE / 8)
212 #define PLT_ENTRY_SIZE (32)
213 #define PLT_SMALL_ENTRY_SIZE (16)
214 #define PLT_TLSDESC_ENTRY_SIZE (32)
215
216 /* Encoding of the nop instruction */
217 #define INSN_NOP 0xd503201f
218
219 #define aarch64_compute_jump_table_size(htab) \
220 (((htab)->root.srelplt == NULL) ? 0 \
221 : (htab)->root.srelplt->reloc_count * GOT_ENTRY_SIZE)
222
223 /* The first entry in a procedure linkage table looks like this
224 if the distance between the PLTGOT and the PLT is < 4GB use
225 these PLT entries. Note that the dynamic linker gets &PLTGOT[2]
226 in x16 and needs to work out PLTGOT[1] by using an address of
227 [x16,#-GOT_ENTRY_SIZE]. */
228 static const bfd_byte elfNN_aarch64_small_plt0_entry[PLT_ENTRY_SIZE] =
229 {
230 0xf0, 0x7b, 0xbf, 0xa9, /* stp x16, x30, [sp, #-16]! */
231 0x10, 0x00, 0x00, 0x90, /* adrp x16, (GOT+16) */
232 #if ARCH_SIZE == 64
233 0x11, 0x0A, 0x40, 0xf9, /* ldr x17, [x16, #PLT_GOT+0x10] */
234 0x10, 0x42, 0x00, 0x91, /* add x16, x16,#PLT_GOT+0x10 */
235 #else
236 0x11, 0x0A, 0x40, 0xb9, /* ldr w17, [x16, #PLT_GOT+0x8] */
237 0x10, 0x22, 0x00, 0x11, /* add w16, w16,#PLT_GOT+0x8 */
238 #endif
239 0x20, 0x02, 0x1f, 0xd6, /* br x17 */
240 0x1f, 0x20, 0x03, 0xd5, /* nop */
241 0x1f, 0x20, 0x03, 0xd5, /* nop */
242 0x1f, 0x20, 0x03, 0xd5, /* nop */
243 };
244
245 /* Per function entry in a procedure linkage table looks like this
246 if the distance between the PLTGOT and the PLT is < 4GB use
247 these PLT entries. */
248 static const bfd_byte elfNN_aarch64_small_plt_entry[PLT_SMALL_ENTRY_SIZE] =
249 {
250 0x10, 0x00, 0x00, 0x90, /* adrp x16, PLTGOT + n * 8 */
251 #if ARCH_SIZE == 64
252 0x11, 0x02, 0x40, 0xf9, /* ldr x17, [x16, PLTGOT + n * 8] */
253 0x10, 0x02, 0x00, 0x91, /* add x16, x16, :lo12:PLTGOT + n * 8 */
254 #else
255 0x11, 0x02, 0x40, 0xb9, /* ldr w17, [x16, PLTGOT + n * 4] */
256 0x10, 0x02, 0x00, 0x11, /* add w16, w16, :lo12:PLTGOT + n * 4 */
257 #endif
258 0x20, 0x02, 0x1f, 0xd6, /* br x17. */
259 };
260
261 static const bfd_byte
262 elfNN_aarch64_tlsdesc_small_plt_entry[PLT_TLSDESC_ENTRY_SIZE] =
263 {
264 0xe2, 0x0f, 0xbf, 0xa9, /* stp x2, x3, [sp, #-16]! */
265 0x02, 0x00, 0x00, 0x90, /* adrp x2, 0 */
266 0x03, 0x00, 0x00, 0x90, /* adrp x3, 0 */
267 #if ARCH_SIZE == 64
268 0x42, 0x00, 0x40, 0xf9, /* ldr x2, [x2, #0] */
269 0x63, 0x00, 0x00, 0x91, /* add x3, x3, 0 */
270 #else
271 0x42, 0x00, 0x40, 0xb9, /* ldr w2, [x2, #0] */
272 0x63, 0x00, 0x00, 0x11, /* add w3, w3, 0 */
273 #endif
274 0x40, 0x00, 0x1f, 0xd6, /* br x2 */
275 0x1f, 0x20, 0x03, 0xd5, /* nop */
276 0x1f, 0x20, 0x03, 0xd5, /* nop */
277 };
278
279 #define elf_info_to_howto elfNN_aarch64_info_to_howto
280 #define elf_info_to_howto_rel elfNN_aarch64_info_to_howto
281
282 #define AARCH64_ELF_ABI_VERSION 0
283
284 /* In case we're on a 32-bit machine, construct a 64-bit "-1" value. */
285 #define ALL_ONES (~ (bfd_vma) 0)
286
287 /* Indexed by the bfd interal reloc enumerators.
288 Therefore, the table needs to be synced with BFD_RELOC_AARCH64_*
289 in reloc.c. */
290
291 static reloc_howto_type elfNN_aarch64_howto_table[] =
292 {
293 EMPTY_HOWTO (0),
294
295 /* Basic data relocations. */
296
297 #if ARCH_SIZE == 64
298 HOWTO (R_AARCH64_NULL, /* type */
299 0, /* rightshift */
300 3, /* size (0 = byte, 1 = short, 2 = long) */
301 0, /* bitsize */
302 FALSE, /* pc_relative */
303 0, /* bitpos */
304 complain_overflow_dont, /* complain_on_overflow */
305 bfd_elf_generic_reloc, /* special_function */
306 "R_AARCH64_NULL", /* name */
307 FALSE, /* partial_inplace */
308 0, /* src_mask */
309 0, /* dst_mask */
310 FALSE), /* pcrel_offset */
311 #else
312 HOWTO (R_AARCH64_NONE, /* type */
313 0, /* rightshift */
314 3, /* size (0 = byte, 1 = short, 2 = long) */
315 0, /* bitsize */
316 FALSE, /* pc_relative */
317 0, /* bitpos */
318 complain_overflow_dont, /* complain_on_overflow */
319 bfd_elf_generic_reloc, /* special_function */
320 "R_AARCH64_NONE", /* name */
321 FALSE, /* partial_inplace */
322 0, /* src_mask */
323 0, /* dst_mask */
324 FALSE), /* pcrel_offset */
325 #endif
326
327 /* .xword: (S+A) */
328 HOWTO64 (AARCH64_R (ABS64), /* type */
329 0, /* rightshift */
330 4, /* size (4 = long long) */
331 64, /* bitsize */
332 FALSE, /* pc_relative */
333 0, /* bitpos */
334 complain_overflow_unsigned, /* complain_on_overflow */
335 bfd_elf_generic_reloc, /* special_function */
336 AARCH64_R_STR (ABS64), /* name */
337 FALSE, /* partial_inplace */
338 ALL_ONES, /* src_mask */
339 ALL_ONES, /* dst_mask */
340 FALSE), /* pcrel_offset */
341
342 /* .word: (S+A) */
343 HOWTO (AARCH64_R (ABS32), /* type */
344 0, /* rightshift */
345 2, /* size (0 = byte, 1 = short, 2 = long) */
346 32, /* bitsize */
347 FALSE, /* pc_relative */
348 0, /* bitpos */
349 complain_overflow_unsigned, /* complain_on_overflow */
350 bfd_elf_generic_reloc, /* special_function */
351 AARCH64_R_STR (ABS32), /* name */
352 FALSE, /* partial_inplace */
353 0xffffffff, /* src_mask */
354 0xffffffff, /* dst_mask */
355 FALSE), /* pcrel_offset */
356
357 /* .half: (S+A) */
358 HOWTO (AARCH64_R (ABS16), /* type */
359 0, /* rightshift */
360 1, /* size (0 = byte, 1 = short, 2 = long) */
361 16, /* bitsize */
362 FALSE, /* pc_relative */
363 0, /* bitpos */
364 complain_overflow_unsigned, /* complain_on_overflow */
365 bfd_elf_generic_reloc, /* special_function */
366 AARCH64_R_STR (ABS16), /* name */
367 FALSE, /* partial_inplace */
368 0xffff, /* src_mask */
369 0xffff, /* dst_mask */
370 FALSE), /* pcrel_offset */
371
372 /* .xword: (S+A-P) */
373 HOWTO64 (AARCH64_R (PREL64), /* type */
374 0, /* rightshift */
375 4, /* size (4 = long long) */
376 64, /* bitsize */
377 TRUE, /* pc_relative */
378 0, /* bitpos */
379 complain_overflow_signed, /* complain_on_overflow */
380 bfd_elf_generic_reloc, /* special_function */
381 AARCH64_R_STR (PREL64), /* name */
382 FALSE, /* partial_inplace */
383 ALL_ONES, /* src_mask */
384 ALL_ONES, /* dst_mask */
385 TRUE), /* pcrel_offset */
386
387 /* .word: (S+A-P) */
388 HOWTO (AARCH64_R (PREL32), /* type */
389 0, /* rightshift */
390 2, /* size (0 = byte, 1 = short, 2 = long) */
391 32, /* bitsize */
392 TRUE, /* pc_relative */
393 0, /* bitpos */
394 complain_overflow_signed, /* complain_on_overflow */
395 bfd_elf_generic_reloc, /* special_function */
396 AARCH64_R_STR (PREL32), /* name */
397 FALSE, /* partial_inplace */
398 0xffffffff, /* src_mask */
399 0xffffffff, /* dst_mask */
400 TRUE), /* pcrel_offset */
401
402 /* .half: (S+A-P) */
403 HOWTO (AARCH64_R (PREL16), /* type */
404 0, /* rightshift */
405 1, /* size (0 = byte, 1 = short, 2 = long) */
406 16, /* bitsize */
407 TRUE, /* pc_relative */
408 0, /* bitpos */
409 complain_overflow_signed, /* complain_on_overflow */
410 bfd_elf_generic_reloc, /* special_function */
411 AARCH64_R_STR (PREL16), /* name */
412 FALSE, /* partial_inplace */
413 0xffff, /* src_mask */
414 0xffff, /* dst_mask */
415 TRUE), /* pcrel_offset */
416
417 /* Group relocations to create a 16, 32, 48 or 64 bit
418 unsigned data or abs address inline. */
419
420 /* MOVZ: ((S+A) >> 0) & 0xffff */
421 HOWTO (AARCH64_R (MOVW_UABS_G0), /* type */
422 0, /* rightshift */
423 2, /* size (0 = byte, 1 = short, 2 = long) */
424 16, /* bitsize */
425 FALSE, /* pc_relative */
426 0, /* bitpos */
427 complain_overflow_unsigned, /* complain_on_overflow */
428 bfd_elf_generic_reloc, /* special_function */
429 AARCH64_R_STR (MOVW_UABS_G0), /* name */
430 FALSE, /* partial_inplace */
431 0xffff, /* src_mask */
432 0xffff, /* dst_mask */
433 FALSE), /* pcrel_offset */
434
435 /* MOVK: ((S+A) >> 0) & 0xffff [no overflow check] */
436 HOWTO (AARCH64_R (MOVW_UABS_G0_NC), /* type */
437 0, /* rightshift */
438 2, /* size (0 = byte, 1 = short, 2 = long) */
439 16, /* bitsize */
440 FALSE, /* pc_relative */
441 0, /* bitpos */
442 complain_overflow_dont, /* complain_on_overflow */
443 bfd_elf_generic_reloc, /* special_function */
444 AARCH64_R_STR (MOVW_UABS_G0_NC), /* name */
445 FALSE, /* partial_inplace */
446 0xffff, /* src_mask */
447 0xffff, /* dst_mask */
448 FALSE), /* pcrel_offset */
449
450 /* MOVZ: ((S+A) >> 16) & 0xffff */
451 HOWTO (AARCH64_R (MOVW_UABS_G1), /* type */
452 16, /* rightshift */
453 2, /* size (0 = byte, 1 = short, 2 = long) */
454 16, /* bitsize */
455 FALSE, /* pc_relative */
456 0, /* bitpos */
457 complain_overflow_unsigned, /* complain_on_overflow */
458 bfd_elf_generic_reloc, /* special_function */
459 AARCH64_R_STR (MOVW_UABS_G1), /* name */
460 FALSE, /* partial_inplace */
461 0xffff, /* src_mask */
462 0xffff, /* dst_mask */
463 FALSE), /* pcrel_offset */
464
465 /* MOVK: ((S+A) >> 16) & 0xffff [no overflow check] */
466 HOWTO64 (AARCH64_R (MOVW_UABS_G1_NC), /* type */
467 16, /* rightshift */
468 2, /* size (0 = byte, 1 = short, 2 = long) */
469 16, /* bitsize */
470 FALSE, /* pc_relative */
471 0, /* bitpos */
472 complain_overflow_dont, /* complain_on_overflow */
473 bfd_elf_generic_reloc, /* special_function */
474 AARCH64_R_STR (MOVW_UABS_G1_NC), /* name */
475 FALSE, /* partial_inplace */
476 0xffff, /* src_mask */
477 0xffff, /* dst_mask */
478 FALSE), /* pcrel_offset */
479
480 /* MOVZ: ((S+A) >> 32) & 0xffff */
481 HOWTO64 (AARCH64_R (MOVW_UABS_G2), /* type */
482 32, /* rightshift */
483 2, /* size (0 = byte, 1 = short, 2 = long) */
484 16, /* bitsize */
485 FALSE, /* pc_relative */
486 0, /* bitpos */
487 complain_overflow_unsigned, /* complain_on_overflow */
488 bfd_elf_generic_reloc, /* special_function */
489 AARCH64_R_STR (MOVW_UABS_G2), /* name */
490 FALSE, /* partial_inplace */
491 0xffff, /* src_mask */
492 0xffff, /* dst_mask */
493 FALSE), /* pcrel_offset */
494
495 /* MOVK: ((S+A) >> 32) & 0xffff [no overflow check] */
496 HOWTO64 (AARCH64_R (MOVW_UABS_G2_NC), /* type */
497 32, /* rightshift */
498 2, /* size (0 = byte, 1 = short, 2 = long) */
499 16, /* bitsize */
500 FALSE, /* pc_relative */
501 0, /* bitpos */
502 complain_overflow_dont, /* complain_on_overflow */
503 bfd_elf_generic_reloc, /* special_function */
504 AARCH64_R_STR (MOVW_UABS_G2_NC), /* name */
505 FALSE, /* partial_inplace */
506 0xffff, /* src_mask */
507 0xffff, /* dst_mask */
508 FALSE), /* pcrel_offset */
509
510 /* MOVZ: ((S+A) >> 48) & 0xffff */
511 HOWTO64 (AARCH64_R (MOVW_UABS_G3), /* type */
512 48, /* rightshift */
513 2, /* size (0 = byte, 1 = short, 2 = long) */
514 16, /* bitsize */
515 FALSE, /* pc_relative */
516 0, /* bitpos */
517 complain_overflow_unsigned, /* complain_on_overflow */
518 bfd_elf_generic_reloc, /* special_function */
519 AARCH64_R_STR (MOVW_UABS_G3), /* name */
520 FALSE, /* partial_inplace */
521 0xffff, /* src_mask */
522 0xffff, /* dst_mask */
523 FALSE), /* pcrel_offset */
524
525 /* Group relocations to create high part of a 16, 32, 48 or 64 bit
526 signed data or abs address inline. Will change instruction
527 to MOVN or MOVZ depending on sign of calculated value. */
528
529 /* MOV[ZN]: ((S+A) >> 0) & 0xffff */
530 HOWTO (AARCH64_R (MOVW_SABS_G0), /* type */
531 0, /* rightshift */
532 2, /* size (0 = byte, 1 = short, 2 = long) */
533 16, /* bitsize */
534 FALSE, /* pc_relative */
535 0, /* bitpos */
536 complain_overflow_signed, /* complain_on_overflow */
537 bfd_elf_generic_reloc, /* special_function */
538 AARCH64_R_STR (MOVW_SABS_G0), /* name */
539 FALSE, /* partial_inplace */
540 0xffff, /* src_mask */
541 0xffff, /* dst_mask */
542 FALSE), /* pcrel_offset */
543
544 /* MOV[ZN]: ((S+A) >> 16) & 0xffff */
545 HOWTO64 (AARCH64_R (MOVW_SABS_G1), /* type */
546 16, /* rightshift */
547 2, /* size (0 = byte, 1 = short, 2 = long) */
548 16, /* bitsize */
549 FALSE, /* pc_relative */
550 0, /* bitpos */
551 complain_overflow_signed, /* complain_on_overflow */
552 bfd_elf_generic_reloc, /* special_function */
553 AARCH64_R_STR (MOVW_SABS_G1), /* name */
554 FALSE, /* partial_inplace */
555 0xffff, /* src_mask */
556 0xffff, /* dst_mask */
557 FALSE), /* pcrel_offset */
558
559 /* MOV[ZN]: ((S+A) >> 32) & 0xffff */
560 HOWTO64 (AARCH64_R (MOVW_SABS_G2), /* type */
561 32, /* rightshift */
562 2, /* size (0 = byte, 1 = short, 2 = long) */
563 16, /* bitsize */
564 FALSE, /* pc_relative */
565 0, /* bitpos */
566 complain_overflow_signed, /* complain_on_overflow */
567 bfd_elf_generic_reloc, /* special_function */
568 AARCH64_R_STR (MOVW_SABS_G2), /* name */
569 FALSE, /* partial_inplace */
570 0xffff, /* src_mask */
571 0xffff, /* dst_mask */
572 FALSE), /* pcrel_offset */
573
574 /* Relocations to generate 19, 21 and 33 bit PC-relative load/store
575 addresses: PG(x) is (x & ~0xfff). */
576
577 /* LD-lit: ((S+A-P) >> 2) & 0x7ffff */
578 HOWTO (AARCH64_R (LD_PREL_LO19), /* type */
579 2, /* rightshift */
580 2, /* size (0 = byte, 1 = short, 2 = long) */
581 19, /* bitsize */
582 TRUE, /* pc_relative */
583 0, /* bitpos */
584 complain_overflow_signed, /* complain_on_overflow */
585 bfd_elf_generic_reloc, /* special_function */
586 AARCH64_R_STR (LD_PREL_LO19), /* name */
587 FALSE, /* partial_inplace */
588 0x7ffff, /* src_mask */
589 0x7ffff, /* dst_mask */
590 TRUE), /* pcrel_offset */
591
592 /* ADR: (S+A-P) & 0x1fffff */
593 HOWTO (AARCH64_R (ADR_PREL_LO21), /* type */
594 0, /* rightshift */
595 2, /* size (0 = byte, 1 = short, 2 = long) */
596 21, /* bitsize */
597 TRUE, /* pc_relative */
598 0, /* bitpos */
599 complain_overflow_signed, /* complain_on_overflow */
600 bfd_elf_generic_reloc, /* special_function */
601 AARCH64_R_STR (ADR_PREL_LO21), /* name */
602 FALSE, /* partial_inplace */
603 0x1fffff, /* src_mask */
604 0x1fffff, /* dst_mask */
605 TRUE), /* pcrel_offset */
606
607 /* ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
608 HOWTO (AARCH64_R (ADR_PREL_PG_HI21), /* type */
609 12, /* rightshift */
610 2, /* size (0 = byte, 1 = short, 2 = long) */
611 21, /* bitsize */
612 TRUE, /* pc_relative */
613 0, /* bitpos */
614 complain_overflow_signed, /* complain_on_overflow */
615 bfd_elf_generic_reloc, /* special_function */
616 AARCH64_R_STR (ADR_PREL_PG_HI21), /* name */
617 FALSE, /* partial_inplace */
618 0x1fffff, /* src_mask */
619 0x1fffff, /* dst_mask */
620 TRUE), /* pcrel_offset */
621
622 /* ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff [no overflow check] */
623 HOWTO64 (AARCH64_R (ADR_PREL_PG_HI21_NC), /* type */
624 12, /* rightshift */
625 2, /* size (0 = byte, 1 = short, 2 = long) */
626 21, /* bitsize */
627 TRUE, /* pc_relative */
628 0, /* bitpos */
629 complain_overflow_dont, /* complain_on_overflow */
630 bfd_elf_generic_reloc, /* special_function */
631 AARCH64_R_STR (ADR_PREL_PG_HI21_NC), /* name */
632 FALSE, /* partial_inplace */
633 0x1fffff, /* src_mask */
634 0x1fffff, /* dst_mask */
635 TRUE), /* pcrel_offset */
636
637 /* ADD: (S+A) & 0xfff [no overflow check] */
638 HOWTO (AARCH64_R (ADD_ABS_LO12_NC), /* type */
639 0, /* rightshift */
640 2, /* size (0 = byte, 1 = short, 2 = long) */
641 12, /* bitsize */
642 FALSE, /* pc_relative */
643 10, /* bitpos */
644 complain_overflow_dont, /* complain_on_overflow */
645 bfd_elf_generic_reloc, /* special_function */
646 AARCH64_R_STR (ADD_ABS_LO12_NC), /* name */
647 FALSE, /* partial_inplace */
648 0x3ffc00, /* src_mask */
649 0x3ffc00, /* dst_mask */
650 FALSE), /* pcrel_offset */
651
652 /* LD/ST8: (S+A) & 0xfff */
653 HOWTO (AARCH64_R (LDST8_ABS_LO12_NC), /* type */
654 0, /* rightshift */
655 2, /* size (0 = byte, 1 = short, 2 = long) */
656 12, /* bitsize */
657 FALSE, /* pc_relative */
658 0, /* bitpos */
659 complain_overflow_dont, /* complain_on_overflow */
660 bfd_elf_generic_reloc, /* special_function */
661 AARCH64_R_STR (LDST8_ABS_LO12_NC), /* name */
662 FALSE, /* partial_inplace */
663 0xfff, /* src_mask */
664 0xfff, /* dst_mask */
665 FALSE), /* pcrel_offset */
666
667 /* Relocations for control-flow instructions. */
668
669 /* TBZ/NZ: ((S+A-P) >> 2) & 0x3fff */
670 HOWTO (AARCH64_R (TSTBR14), /* type */
671 2, /* rightshift */
672 2, /* size (0 = byte, 1 = short, 2 = long) */
673 14, /* bitsize */
674 TRUE, /* pc_relative */
675 0, /* bitpos */
676 complain_overflow_signed, /* complain_on_overflow */
677 bfd_elf_generic_reloc, /* special_function */
678 AARCH64_R_STR (TSTBR14), /* name */
679 FALSE, /* partial_inplace */
680 0x3fff, /* src_mask */
681 0x3fff, /* dst_mask */
682 TRUE), /* pcrel_offset */
683
684 /* B.cond: ((S+A-P) >> 2) & 0x7ffff */
685 HOWTO (AARCH64_R (CONDBR19), /* type */
686 2, /* rightshift */
687 2, /* size (0 = byte, 1 = short, 2 = long) */
688 19, /* bitsize */
689 TRUE, /* pc_relative */
690 0, /* bitpos */
691 complain_overflow_signed, /* complain_on_overflow */
692 bfd_elf_generic_reloc, /* special_function */
693 AARCH64_R_STR (CONDBR19), /* name */
694 FALSE, /* partial_inplace */
695 0x7ffff, /* src_mask */
696 0x7ffff, /* dst_mask */
697 TRUE), /* pcrel_offset */
698
699 /* B: ((S+A-P) >> 2) & 0x3ffffff */
700 HOWTO (AARCH64_R (JUMP26), /* type */
701 2, /* rightshift */
702 2, /* size (0 = byte, 1 = short, 2 = long) */
703 26, /* bitsize */
704 TRUE, /* pc_relative */
705 0, /* bitpos */
706 complain_overflow_signed, /* complain_on_overflow */
707 bfd_elf_generic_reloc, /* special_function */
708 AARCH64_R_STR (JUMP26), /* name */
709 FALSE, /* partial_inplace */
710 0x3ffffff, /* src_mask */
711 0x3ffffff, /* dst_mask */
712 TRUE), /* pcrel_offset */
713
714 /* BL: ((S+A-P) >> 2) & 0x3ffffff */
715 HOWTO (AARCH64_R (CALL26), /* type */
716 2, /* rightshift */
717 2, /* size (0 = byte, 1 = short, 2 = long) */
718 26, /* bitsize */
719 TRUE, /* pc_relative */
720 0, /* bitpos */
721 complain_overflow_signed, /* complain_on_overflow */
722 bfd_elf_generic_reloc, /* special_function */
723 AARCH64_R_STR (CALL26), /* name */
724 FALSE, /* partial_inplace */
725 0x3ffffff, /* src_mask */
726 0x3ffffff, /* dst_mask */
727 TRUE), /* pcrel_offset */
728
729 /* LD/ST16: (S+A) & 0xffe */
730 HOWTO (AARCH64_R (LDST16_ABS_LO12_NC), /* type */
731 1, /* rightshift */
732 2, /* size (0 = byte, 1 = short, 2 = long) */
733 12, /* bitsize */
734 FALSE, /* pc_relative */
735 0, /* bitpos */
736 complain_overflow_dont, /* complain_on_overflow */
737 bfd_elf_generic_reloc, /* special_function */
738 AARCH64_R_STR (LDST16_ABS_LO12_NC), /* name */
739 FALSE, /* partial_inplace */
740 0xffe, /* src_mask */
741 0xffe, /* dst_mask */
742 FALSE), /* pcrel_offset */
743
744 /* LD/ST32: (S+A) & 0xffc */
745 HOWTO (AARCH64_R (LDST32_ABS_LO12_NC), /* type */
746 2, /* rightshift */
747 2, /* size (0 = byte, 1 = short, 2 = long) */
748 12, /* bitsize */
749 FALSE, /* pc_relative */
750 0, /* bitpos */
751 complain_overflow_dont, /* complain_on_overflow */
752 bfd_elf_generic_reloc, /* special_function */
753 AARCH64_R_STR (LDST32_ABS_LO12_NC), /* name */
754 FALSE, /* partial_inplace */
755 0xffc, /* src_mask */
756 0xffc, /* dst_mask */
757 FALSE), /* pcrel_offset */
758
759 /* LD/ST64: (S+A) & 0xff8 */
760 HOWTO (AARCH64_R (LDST64_ABS_LO12_NC), /* type */
761 3, /* rightshift */
762 2, /* size (0 = byte, 1 = short, 2 = long) */
763 12, /* bitsize */
764 FALSE, /* pc_relative */
765 0, /* bitpos */
766 complain_overflow_dont, /* complain_on_overflow */
767 bfd_elf_generic_reloc, /* special_function */
768 AARCH64_R_STR (LDST64_ABS_LO12_NC), /* name */
769 FALSE, /* partial_inplace */
770 0xff8, /* src_mask */
771 0xff8, /* dst_mask */
772 FALSE), /* pcrel_offset */
773
774 /* LD/ST128: (S+A) & 0xff0 */
775 HOWTO (AARCH64_R (LDST128_ABS_LO12_NC), /* type */
776 4, /* rightshift */
777 2, /* size (0 = byte, 1 = short, 2 = long) */
778 12, /* bitsize */
779 FALSE, /* pc_relative */
780 0, /* bitpos */
781 complain_overflow_dont, /* complain_on_overflow */
782 bfd_elf_generic_reloc, /* special_function */
783 AARCH64_R_STR (LDST128_ABS_LO12_NC), /* name */
784 FALSE, /* partial_inplace */
785 0xff0, /* src_mask */
786 0xff0, /* dst_mask */
787 FALSE), /* pcrel_offset */
788
789 /* Set a load-literal immediate field to bits
790 0x1FFFFC of G(S)-P */
791 HOWTO (AARCH64_R (GOT_LD_PREL19), /* type */
792 2, /* rightshift */
793 2, /* size (0 = byte,1 = short,2 = long) */
794 19, /* bitsize */
795 TRUE, /* pc_relative */
796 0, /* bitpos */
797 complain_overflow_signed, /* complain_on_overflow */
798 bfd_elf_generic_reloc, /* special_function */
799 AARCH64_R_STR (GOT_LD_PREL19), /* name */
800 FALSE, /* partial_inplace */
801 0xffffe0, /* src_mask */
802 0xffffe0, /* dst_mask */
803 TRUE), /* pcrel_offset */
804
805 /* Get to the page for the GOT entry for the symbol
806 (G(S) - P) using an ADRP instruction. */
807 HOWTO (AARCH64_R (ADR_GOT_PAGE), /* type */
808 12, /* rightshift */
809 2, /* size (0 = byte, 1 = short, 2 = long) */
810 21, /* bitsize */
811 TRUE, /* pc_relative */
812 0, /* bitpos */
813 complain_overflow_dont, /* complain_on_overflow */
814 bfd_elf_generic_reloc, /* special_function */
815 AARCH64_R_STR (ADR_GOT_PAGE), /* name */
816 FALSE, /* partial_inplace */
817 0x1fffff, /* src_mask */
818 0x1fffff, /* dst_mask */
819 TRUE), /* pcrel_offset */
820
821 /* LD64: GOT offset G(S) & 0xff8 */
822 HOWTO64 (AARCH64_R (LD64_GOT_LO12_NC), /* type */
823 3, /* rightshift */
824 2, /* size (0 = byte, 1 = short, 2 = long) */
825 12, /* bitsize */
826 FALSE, /* pc_relative */
827 0, /* bitpos */
828 complain_overflow_dont, /* complain_on_overflow */
829 bfd_elf_generic_reloc, /* special_function */
830 AARCH64_R_STR (LD64_GOT_LO12_NC), /* name */
831 FALSE, /* partial_inplace */
832 0xff8, /* src_mask */
833 0xff8, /* dst_mask */
834 FALSE), /* pcrel_offset */
835
836 /* LD32: GOT offset G(S) & 0xffc */
837 HOWTO32 (AARCH64_R (LD32_GOT_LO12_NC), /* type */
838 2, /* rightshift */
839 2, /* size (0 = byte, 1 = short, 2 = long) */
840 12, /* bitsize */
841 FALSE, /* pc_relative */
842 0, /* bitpos */
843 complain_overflow_dont, /* complain_on_overflow */
844 bfd_elf_generic_reloc, /* special_function */
845 AARCH64_R_STR (LD32_GOT_LO12_NC), /* name */
846 FALSE, /* partial_inplace */
847 0xffc, /* src_mask */
848 0xffc, /* dst_mask */
849 FALSE), /* pcrel_offset */
850
851 /* Get to the page for the GOT entry for the symbol
852 (G(S) - P) using an ADRP instruction. */
853 HOWTO (AARCH64_R (TLSGD_ADR_PAGE21), /* type */
854 12, /* rightshift */
855 2, /* size (0 = byte, 1 = short, 2 = long) */
856 21, /* bitsize */
857 TRUE, /* pc_relative */
858 0, /* bitpos */
859 complain_overflow_dont, /* complain_on_overflow */
860 bfd_elf_generic_reloc, /* special_function */
861 AARCH64_R_STR (TLSGD_ADR_PAGE21), /* name */
862 FALSE, /* partial_inplace */
863 0x1fffff, /* src_mask */
864 0x1fffff, /* dst_mask */
865 TRUE), /* pcrel_offset */
866
867 HOWTO (AARCH64_R (TLSGD_ADR_PREL21), /* type */
868 0, /* rightshift */
869 2, /* size (0 = byte, 1 = short, 2 = long) */
870 21, /* bitsize */
871 TRUE, /* pc_relative */
872 0, /* bitpos */
873 complain_overflow_dont, /* complain_on_overflow */
874 bfd_elf_generic_reloc, /* special_function */
875 AARCH64_R_STR (TLSGD_ADR_PREL21), /* name */
876 FALSE, /* partial_inplace */
877 0x1fffff, /* src_mask */
878 0x1fffff, /* dst_mask */
879 TRUE), /* pcrel_offset */
880
881 /* ADD: GOT offset G(S) & 0xff8 [no overflow check] */
882 HOWTO (AARCH64_R (TLSGD_ADD_LO12_NC), /* type */
883 0, /* rightshift */
884 2, /* size (0 = byte, 1 = short, 2 = long) */
885 12, /* bitsize */
886 FALSE, /* pc_relative */
887 0, /* bitpos */
888 complain_overflow_dont, /* complain_on_overflow */
889 bfd_elf_generic_reloc, /* special_function */
890 AARCH64_R_STR (TLSGD_ADD_LO12_NC), /* name */
891 FALSE, /* partial_inplace */
892 0xfff, /* src_mask */
893 0xfff, /* dst_mask */
894 FALSE), /* pcrel_offset */
895
896 HOWTO64 (AARCH64_R (TLSIE_MOVW_GOTTPREL_G1), /* type */
897 16, /* rightshift */
898 2, /* size (0 = byte, 1 = short, 2 = long) */
899 16, /* bitsize */
900 FALSE, /* pc_relative */
901 0, /* bitpos */
902 complain_overflow_dont, /* complain_on_overflow */
903 bfd_elf_generic_reloc, /* special_function */
904 AARCH64_R_STR (TLSIE_MOVW_GOTTPREL_G1), /* name */
905 FALSE, /* partial_inplace */
906 0xffff, /* src_mask */
907 0xffff, /* dst_mask */
908 FALSE), /* pcrel_offset */
909
910 HOWTO64 (AARCH64_R (TLSIE_MOVW_GOTTPREL_G0_NC), /* type */
911 0, /* rightshift */
912 2, /* size (0 = byte, 1 = short, 2 = long) */
913 16, /* bitsize */
914 FALSE, /* pc_relative */
915 0, /* bitpos */
916 complain_overflow_dont, /* complain_on_overflow */
917 bfd_elf_generic_reloc, /* special_function */
918 AARCH64_R_STR (TLSIE_MOVW_GOTTPREL_G0_NC), /* name */
919 FALSE, /* partial_inplace */
920 0xffff, /* src_mask */
921 0xffff, /* dst_mask */
922 FALSE), /* pcrel_offset */
923
924 HOWTO (AARCH64_R (TLSIE_ADR_GOTTPREL_PAGE21), /* type */
925 12, /* rightshift */
926 2, /* size (0 = byte, 1 = short, 2 = long) */
927 21, /* bitsize */
928 FALSE, /* pc_relative */
929 0, /* bitpos */
930 complain_overflow_dont, /* complain_on_overflow */
931 bfd_elf_generic_reloc, /* special_function */
932 AARCH64_R_STR (TLSIE_ADR_GOTTPREL_PAGE21), /* name */
933 FALSE, /* partial_inplace */
934 0x1fffff, /* src_mask */
935 0x1fffff, /* dst_mask */
936 FALSE), /* pcrel_offset */
937
938 HOWTO64 (AARCH64_R (TLSIE_LD64_GOTTPREL_LO12_NC), /* type */
939 3, /* rightshift */
940 2, /* size (0 = byte, 1 = short, 2 = long) */
941 12, /* bitsize */
942 FALSE, /* pc_relative */
943 0, /* bitpos */
944 complain_overflow_dont, /* complain_on_overflow */
945 bfd_elf_generic_reloc, /* special_function */
946 AARCH64_R_STR (TLSIE_LD64_GOTTPREL_LO12_NC), /* name */
947 FALSE, /* partial_inplace */
948 0xff8, /* src_mask */
949 0xff8, /* dst_mask */
950 FALSE), /* pcrel_offset */
951
952 HOWTO32 (AARCH64_R (TLSIE_LD32_GOTTPREL_LO12_NC), /* type */
953 2, /* rightshift */
954 2, /* size (0 = byte, 1 = short, 2 = long) */
955 12, /* bitsize */
956 FALSE, /* pc_relative */
957 0, /* bitpos */
958 complain_overflow_dont, /* complain_on_overflow */
959 bfd_elf_generic_reloc, /* special_function */
960 AARCH64_R_STR (TLSIE_LD32_GOTTPREL_LO12_NC), /* name */
961 FALSE, /* partial_inplace */
962 0xffc, /* src_mask */
963 0xffc, /* dst_mask */
964 FALSE), /* pcrel_offset */
965
966 HOWTO (AARCH64_R (TLSIE_LD_GOTTPREL_PREL19), /* type */
967 2, /* rightshift */
968 2, /* size (0 = byte, 1 = short, 2 = long) */
969 19, /* bitsize */
970 FALSE, /* pc_relative */
971 0, /* bitpos */
972 complain_overflow_dont, /* complain_on_overflow */
973 bfd_elf_generic_reloc, /* special_function */
974 AARCH64_R_STR (TLSIE_LD_GOTTPREL_PREL19), /* name */
975 FALSE, /* partial_inplace */
976 0x1ffffc, /* src_mask */
977 0x1ffffc, /* dst_mask */
978 FALSE), /* pcrel_offset */
979
980 HOWTO64 (AARCH64_R (TLSLE_MOVW_TPREL_G2), /* type */
981 32, /* rightshift */
982 2, /* size (0 = byte, 1 = short, 2 = long) */
983 16, /* bitsize */
984 FALSE, /* pc_relative */
985 0, /* bitpos */
986 complain_overflow_unsigned, /* complain_on_overflow */
987 bfd_elf_generic_reloc, /* special_function */
988 AARCH64_R_STR (TLSLE_MOVW_TPREL_G2), /* name */
989 FALSE, /* partial_inplace */
990 0xffff, /* src_mask */
991 0xffff, /* dst_mask */
992 FALSE), /* pcrel_offset */
993
994 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G1), /* type */
995 16, /* rightshift */
996 2, /* size (0 = byte, 1 = short, 2 = long) */
997 16, /* bitsize */
998 FALSE, /* pc_relative */
999 0, /* bitpos */
1000 complain_overflow_dont, /* complain_on_overflow */
1001 bfd_elf_generic_reloc, /* special_function */
1002 AARCH64_R_STR (TLSLE_MOVW_TPREL_G1), /* name */
1003 FALSE, /* partial_inplace */
1004 0xffff, /* src_mask */
1005 0xffff, /* dst_mask */
1006 FALSE), /* pcrel_offset */
1007
1008 HOWTO64 (AARCH64_R (TLSLE_MOVW_TPREL_G1_NC), /* type */
1009 16, /* rightshift */
1010 2, /* size (0 = byte, 1 = short, 2 = long) */
1011 16, /* bitsize */
1012 FALSE, /* pc_relative */
1013 0, /* bitpos */
1014 complain_overflow_dont, /* complain_on_overflow */
1015 bfd_elf_generic_reloc, /* special_function */
1016 AARCH64_R_STR (TLSLE_MOVW_TPREL_G1_NC), /* name */
1017 FALSE, /* partial_inplace */
1018 0xffff, /* src_mask */
1019 0xffff, /* dst_mask */
1020 FALSE), /* pcrel_offset */
1021
1022 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G0), /* type */
1023 0, /* rightshift */
1024 2, /* size (0 = byte, 1 = short, 2 = long) */
1025 16, /* bitsize */
1026 FALSE, /* pc_relative */
1027 0, /* bitpos */
1028 complain_overflow_dont, /* complain_on_overflow */
1029 bfd_elf_generic_reloc, /* special_function */
1030 AARCH64_R_STR (TLSLE_MOVW_TPREL_G0), /* name */
1031 FALSE, /* partial_inplace */
1032 0xffff, /* src_mask */
1033 0xffff, /* dst_mask */
1034 FALSE), /* pcrel_offset */
1035
1036 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G0_NC), /* type */
1037 0, /* rightshift */
1038 2, /* size (0 = byte, 1 = short, 2 = long) */
1039 16, /* bitsize */
1040 FALSE, /* pc_relative */
1041 0, /* bitpos */
1042 complain_overflow_dont, /* complain_on_overflow */
1043 bfd_elf_generic_reloc, /* special_function */
1044 AARCH64_R_STR (TLSLE_MOVW_TPREL_G0_NC), /* name */
1045 FALSE, /* partial_inplace */
1046 0xffff, /* src_mask */
1047 0xffff, /* dst_mask */
1048 FALSE), /* pcrel_offset */
1049
1050 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_HI12), /* type */
1051 12, /* rightshift */
1052 2, /* size (0 = byte, 1 = short, 2 = long) */
1053 12, /* bitsize */
1054 FALSE, /* pc_relative */
1055 0, /* bitpos */
1056 complain_overflow_unsigned, /* complain_on_overflow */
1057 bfd_elf_generic_reloc, /* special_function */
1058 AARCH64_R_STR (TLSLE_ADD_TPREL_HI12), /* name */
1059 FALSE, /* partial_inplace */
1060 0xfff, /* src_mask */
1061 0xfff, /* dst_mask */
1062 FALSE), /* pcrel_offset */
1063
1064 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_LO12), /* type */
1065 0, /* rightshift */
1066 2, /* size (0 = byte, 1 = short, 2 = long) */
1067 12, /* bitsize */
1068 FALSE, /* pc_relative */
1069 0, /* bitpos */
1070 complain_overflow_dont, /* complain_on_overflow */
1071 bfd_elf_generic_reloc, /* special_function */
1072 AARCH64_R_STR (TLSLE_ADD_TPREL_LO12), /* name */
1073 FALSE, /* partial_inplace */
1074 0xfff, /* src_mask */
1075 0xfff, /* dst_mask */
1076 FALSE), /* pcrel_offset */
1077
1078 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_LO12_NC), /* type */
1079 0, /* rightshift */
1080 2, /* size (0 = byte, 1 = short, 2 = long) */
1081 12, /* bitsize */
1082 FALSE, /* pc_relative */
1083 0, /* bitpos */
1084 complain_overflow_dont, /* complain_on_overflow */
1085 bfd_elf_generic_reloc, /* special_function */
1086 AARCH64_R_STR (TLSLE_ADD_TPREL_LO12_NC), /* name */
1087 FALSE, /* partial_inplace */
1088 0xfff, /* src_mask */
1089 0xfff, /* dst_mask */
1090 FALSE), /* pcrel_offset */
1091
1092 HOWTO (AARCH64_R (TLSDESC_LD_PREL19), /* type */
1093 2, /* rightshift */
1094 2, /* size (0 = byte, 1 = short, 2 = long) */
1095 19, /* bitsize */
1096 TRUE, /* pc_relative */
1097 0, /* bitpos */
1098 complain_overflow_dont, /* complain_on_overflow */
1099 bfd_elf_generic_reloc, /* special_function */
1100 AARCH64_R_STR (TLSDESC_LD_PREL19), /* name */
1101 FALSE, /* partial_inplace */
1102 0x0ffffe0, /* src_mask */
1103 0x0ffffe0, /* dst_mask */
1104 TRUE), /* pcrel_offset */
1105
1106 HOWTO (AARCH64_R (TLSDESC_ADR_PREL21), /* type */
1107 0, /* rightshift */
1108 2, /* size (0 = byte, 1 = short, 2 = long) */
1109 21, /* bitsize */
1110 TRUE, /* pc_relative */
1111 0, /* bitpos */
1112 complain_overflow_dont, /* complain_on_overflow */
1113 bfd_elf_generic_reloc, /* special_function */
1114 AARCH64_R_STR (TLSDESC_ADR_PREL21), /* name */
1115 FALSE, /* partial_inplace */
1116 0x1fffff, /* src_mask */
1117 0x1fffff, /* dst_mask */
1118 TRUE), /* pcrel_offset */
1119
1120 /* Get to the page for the GOT entry for the symbol
1121 (G(S) - P) using an ADRP instruction. */
1122 HOWTO (AARCH64_R (TLSDESC_ADR_PAGE21), /* type */
1123 12, /* rightshift */
1124 2, /* size (0 = byte, 1 = short, 2 = long) */
1125 21, /* bitsize */
1126 TRUE, /* pc_relative */
1127 0, /* bitpos */
1128 complain_overflow_dont, /* complain_on_overflow */
1129 bfd_elf_generic_reloc, /* special_function */
1130 AARCH64_R_STR (TLSDESC_ADR_PAGE21), /* name */
1131 FALSE, /* partial_inplace */
1132 0x1fffff, /* src_mask */
1133 0x1fffff, /* dst_mask */
1134 TRUE), /* pcrel_offset */
1135
1136 /* LD64: GOT offset G(S) & 0xff8. */
1137 HOWTO64 (AARCH64_R (TLSDESC_LD64_LO12_NC), /* type */
1138 3, /* rightshift */
1139 2, /* size (0 = byte, 1 = short, 2 = long) */
1140 12, /* bitsize */
1141 FALSE, /* pc_relative */
1142 0, /* bitpos */
1143 complain_overflow_dont, /* complain_on_overflow */
1144 bfd_elf_generic_reloc, /* special_function */
1145 AARCH64_R_STR (TLSDESC_LD64_LO12_NC), /* name */
1146 FALSE, /* partial_inplace */
1147 0xff8, /* src_mask */
1148 0xff8, /* dst_mask */
1149 FALSE), /* pcrel_offset */
1150
1151 /* LD32: GOT offset G(S) & 0xffc. */
1152 HOWTO32 (AARCH64_R (TLSDESC_LD32_LO12_NC), /* type */
1153 2, /* rightshift */
1154 2, /* size (0 = byte, 1 = short, 2 = long) */
1155 12, /* bitsize */
1156 FALSE, /* pc_relative */
1157 0, /* bitpos */
1158 complain_overflow_dont, /* complain_on_overflow */
1159 bfd_elf_generic_reloc, /* special_function */
1160 AARCH64_R_STR (TLSDESC_LD32_LO12_NC), /* name */
1161 FALSE, /* partial_inplace */
1162 0xffc, /* src_mask */
1163 0xffc, /* dst_mask */
1164 FALSE), /* pcrel_offset */
1165
1166 /* ADD: GOT offset G(S) & 0xfff. */
1167 HOWTO (AARCH64_R (TLSDESC_ADD_LO12_NC), /* type */
1168 0, /* rightshift */
1169 2, /* size (0 = byte, 1 = short, 2 = long) */
1170 12, /* bitsize */
1171 FALSE, /* pc_relative */
1172 0, /* bitpos */
1173 complain_overflow_dont, /* complain_on_overflow */
1174 bfd_elf_generic_reloc, /* special_function */
1175 AARCH64_R_STR (TLSDESC_ADD_LO12_NC), /* name */
1176 FALSE, /* partial_inplace */
1177 0xfff, /* src_mask */
1178 0xfff, /* dst_mask */
1179 FALSE), /* pcrel_offset */
1180
1181 HOWTO64 (AARCH64_R (TLSDESC_OFF_G1), /* type */
1182 16, /* rightshift */
1183 2, /* size (0 = byte, 1 = short, 2 = long) */
1184 12, /* bitsize */
1185 FALSE, /* pc_relative */
1186 0, /* bitpos */
1187 complain_overflow_dont, /* complain_on_overflow */
1188 bfd_elf_generic_reloc, /* special_function */
1189 AARCH64_R_STR (TLSDESC_OFF_G1), /* name */
1190 FALSE, /* partial_inplace */
1191 0xffff, /* src_mask */
1192 0xffff, /* dst_mask */
1193 FALSE), /* pcrel_offset */
1194
1195 HOWTO64 (AARCH64_R (TLSDESC_OFF_G0_NC), /* type */
1196 0, /* rightshift */
1197 2, /* size (0 = byte, 1 = short, 2 = long) */
1198 12, /* bitsize */
1199 FALSE, /* pc_relative */
1200 0, /* bitpos */
1201 complain_overflow_dont, /* complain_on_overflow */
1202 bfd_elf_generic_reloc, /* special_function */
1203 AARCH64_R_STR (TLSDESC_OFF_G0_NC), /* name */
1204 FALSE, /* partial_inplace */
1205 0xffff, /* src_mask */
1206 0xffff, /* dst_mask */
1207 FALSE), /* pcrel_offset */
1208
1209 HOWTO64 (AARCH64_R (TLSDESC_LDR), /* type */
1210 0, /* rightshift */
1211 2, /* size (0 = byte, 1 = short, 2 = long) */
1212 12, /* bitsize */
1213 FALSE, /* pc_relative */
1214 0, /* bitpos */
1215 complain_overflow_dont, /* complain_on_overflow */
1216 bfd_elf_generic_reloc, /* special_function */
1217 AARCH64_R_STR (TLSDESC_LDR), /* name */
1218 FALSE, /* partial_inplace */
1219 0x0, /* src_mask */
1220 0x0, /* dst_mask */
1221 FALSE), /* pcrel_offset */
1222
1223 HOWTO64 (AARCH64_R (TLSDESC_ADD), /* type */
1224 0, /* rightshift */
1225 2, /* size (0 = byte, 1 = short, 2 = long) */
1226 12, /* bitsize */
1227 FALSE, /* pc_relative */
1228 0, /* bitpos */
1229 complain_overflow_dont, /* complain_on_overflow */
1230 bfd_elf_generic_reloc, /* special_function */
1231 AARCH64_R_STR (TLSDESC_ADD), /* name */
1232 FALSE, /* partial_inplace */
1233 0x0, /* src_mask */
1234 0x0, /* dst_mask */
1235 FALSE), /* pcrel_offset */
1236
1237 HOWTO (AARCH64_R (TLSDESC_CALL), /* type */
1238 0, /* rightshift */
1239 2, /* size (0 = byte, 1 = short, 2 = long) */
1240 0, /* bitsize */
1241 FALSE, /* pc_relative */
1242 0, /* bitpos */
1243 complain_overflow_dont, /* complain_on_overflow */
1244 bfd_elf_generic_reloc, /* special_function */
1245 AARCH64_R_STR (TLSDESC_CALL), /* name */
1246 FALSE, /* partial_inplace */
1247 0x0, /* src_mask */
1248 0x0, /* dst_mask */
1249 FALSE), /* pcrel_offset */
1250
1251 HOWTO (AARCH64_R (COPY), /* type */
1252 0, /* rightshift */
1253 2, /* size (0 = byte, 1 = short, 2 = long) */
1254 64, /* bitsize */
1255 FALSE, /* pc_relative */
1256 0, /* bitpos */
1257 complain_overflow_bitfield, /* complain_on_overflow */
1258 bfd_elf_generic_reloc, /* special_function */
1259 AARCH64_R_STR (COPY), /* name */
1260 TRUE, /* partial_inplace */
1261 0xffffffff, /* src_mask */
1262 0xffffffff, /* dst_mask */
1263 FALSE), /* pcrel_offset */
1264
1265 HOWTO (AARCH64_R (GLOB_DAT), /* type */
1266 0, /* rightshift */
1267 2, /* size (0 = byte, 1 = short, 2 = long) */
1268 64, /* bitsize */
1269 FALSE, /* pc_relative */
1270 0, /* bitpos */
1271 complain_overflow_bitfield, /* complain_on_overflow */
1272 bfd_elf_generic_reloc, /* special_function */
1273 AARCH64_R_STR (GLOB_DAT), /* name */
1274 TRUE, /* partial_inplace */
1275 0xffffffff, /* src_mask */
1276 0xffffffff, /* dst_mask */
1277 FALSE), /* pcrel_offset */
1278
1279 HOWTO (AARCH64_R (JUMP_SLOT), /* type */
1280 0, /* rightshift */
1281 2, /* size (0 = byte, 1 = short, 2 = long) */
1282 64, /* bitsize */
1283 FALSE, /* pc_relative */
1284 0, /* bitpos */
1285 complain_overflow_bitfield, /* complain_on_overflow */
1286 bfd_elf_generic_reloc, /* special_function */
1287 AARCH64_R_STR (JUMP_SLOT), /* name */
1288 TRUE, /* partial_inplace */
1289 0xffffffff, /* src_mask */
1290 0xffffffff, /* dst_mask */
1291 FALSE), /* pcrel_offset */
1292
1293 HOWTO (AARCH64_R (RELATIVE), /* type */
1294 0, /* rightshift */
1295 2, /* size (0 = byte, 1 = short, 2 = long) */
1296 64, /* bitsize */
1297 FALSE, /* pc_relative */
1298 0, /* bitpos */
1299 complain_overflow_bitfield, /* complain_on_overflow */
1300 bfd_elf_generic_reloc, /* special_function */
1301 AARCH64_R_STR (RELATIVE), /* name */
1302 TRUE, /* partial_inplace */
1303 ALL_ONES, /* src_mask */
1304 ALL_ONES, /* dst_mask */
1305 FALSE), /* pcrel_offset */
1306
1307 HOWTO (AARCH64_R (TLS_DTPMOD), /* type */
1308 0, /* rightshift */
1309 2, /* size (0 = byte, 1 = short, 2 = long) */
1310 64, /* bitsize */
1311 FALSE, /* pc_relative */
1312 0, /* bitpos */
1313 complain_overflow_dont, /* complain_on_overflow */
1314 bfd_elf_generic_reloc, /* special_function */
1315 #if ARCH_SIZE == 64
1316 AARCH64_R_STR (TLS_DTPMOD64), /* name */
1317 #else
1318 AARCH64_R_STR (TLS_DTPMOD), /* name */
1319 #endif
1320 FALSE, /* partial_inplace */
1321 0, /* src_mask */
1322 ALL_ONES, /* dst_mask */
1323 FALSE), /* pc_reloffset */
1324
1325 HOWTO (AARCH64_R (TLS_DTPREL), /* type */
1326 0, /* rightshift */
1327 2, /* size (0 = byte, 1 = short, 2 = long) */
1328 64, /* bitsize */
1329 FALSE, /* pc_relative */
1330 0, /* bitpos */
1331 complain_overflow_dont, /* complain_on_overflow */
1332 bfd_elf_generic_reloc, /* special_function */
1333 #if ARCH_SIZE == 64
1334 AARCH64_R_STR (TLS_DTPREL64), /* name */
1335 #else
1336 AARCH64_R_STR (TLS_DTPREL), /* name */
1337 #endif
1338 FALSE, /* partial_inplace */
1339 0, /* src_mask */
1340 ALL_ONES, /* dst_mask */
1341 FALSE), /* pcrel_offset */
1342
1343 HOWTO (AARCH64_R (TLS_TPREL), /* type */
1344 0, /* rightshift */
1345 2, /* size (0 = byte, 1 = short, 2 = long) */
1346 64, /* bitsize */
1347 FALSE, /* pc_relative */
1348 0, /* bitpos */
1349 complain_overflow_dont, /* complain_on_overflow */
1350 bfd_elf_generic_reloc, /* special_function */
1351 #if ARCH_SIZE == 64
1352 AARCH64_R_STR (TLS_TPREL64), /* name */
1353 #else
1354 AARCH64_R_STR (TLS_TPREL), /* name */
1355 #endif
1356 FALSE, /* partial_inplace */
1357 0, /* src_mask */
1358 ALL_ONES, /* dst_mask */
1359 FALSE), /* pcrel_offset */
1360
1361 HOWTO (AARCH64_R (TLSDESC), /* type */
1362 0, /* rightshift */
1363 2, /* size (0 = byte, 1 = short, 2 = long) */
1364 64, /* bitsize */
1365 FALSE, /* pc_relative */
1366 0, /* bitpos */
1367 complain_overflow_dont, /* complain_on_overflow */
1368 bfd_elf_generic_reloc, /* special_function */
1369 AARCH64_R_STR (TLSDESC), /* name */
1370 FALSE, /* partial_inplace */
1371 0, /* src_mask */
1372 ALL_ONES, /* dst_mask */
1373 FALSE), /* pcrel_offset */
1374
1375 HOWTO (AARCH64_R (IRELATIVE), /* type */
1376 0, /* rightshift */
1377 2, /* size (0 = byte, 1 = short, 2 = long) */
1378 64, /* bitsize */
1379 FALSE, /* pc_relative */
1380 0, /* bitpos */
1381 complain_overflow_bitfield, /* complain_on_overflow */
1382 bfd_elf_generic_reloc, /* special_function */
1383 AARCH64_R_STR (IRELATIVE), /* name */
1384 FALSE, /* partial_inplace */
1385 0, /* src_mask */
1386 ALL_ONES, /* dst_mask */
1387 FALSE), /* pcrel_offset */
1388
1389 EMPTY_HOWTO (0),
1390 };
1391
1392 static reloc_howto_type elfNN_aarch64_howto_none =
1393 HOWTO (R_AARCH64_NONE, /* type */
1394 0, /* rightshift */
1395 3, /* size (0 = byte, 1 = short, 2 = long) */
1396 0, /* bitsize */
1397 FALSE, /* pc_relative */
1398 0, /* bitpos */
1399 complain_overflow_dont,/* complain_on_overflow */
1400 bfd_elf_generic_reloc, /* special_function */
1401 "R_AARCH64_NONE", /* name */
1402 FALSE, /* partial_inplace */
1403 0, /* src_mask */
1404 0, /* dst_mask */
1405 FALSE); /* pcrel_offset */
1406
1407 /* Given HOWTO, return the bfd internal relocation enumerator. */
1408
1409 static bfd_reloc_code_real_type
1410 elfNN_aarch64_bfd_reloc_from_howto (reloc_howto_type *howto)
1411 {
1412 const int size
1413 = (int) ARRAY_SIZE (elfNN_aarch64_howto_table);
1414 const ptrdiff_t offset
1415 = howto - elfNN_aarch64_howto_table;
1416
1417 if (offset > 0 && offset < size - 1)
1418 return BFD_RELOC_AARCH64_RELOC_START + offset;
1419
1420 if (howto == &elfNN_aarch64_howto_none)
1421 return BFD_RELOC_AARCH64_NONE;
1422
1423 return BFD_RELOC_AARCH64_RELOC_START;
1424 }
1425
1426 /* Given R_TYPE, return the bfd internal relocation enumerator. */
1427
1428 static bfd_reloc_code_real_type
1429 elfNN_aarch64_bfd_reloc_from_type (unsigned int r_type)
1430 {
1431 static bfd_boolean initialized_p = FALSE;
1432 /* Indexed by R_TYPE, values are offsets in the howto_table. */
1433 static unsigned int offsets[R_AARCH64_end];
1434
1435 if (initialized_p == FALSE)
1436 {
1437 unsigned int i;
1438
1439 for (i = 1; i < ARRAY_SIZE (elfNN_aarch64_howto_table) - 1; ++i)
1440 if (elfNN_aarch64_howto_table[i].type != 0)
1441 offsets[elfNN_aarch64_howto_table[i].type] = i;
1442
1443 initialized_p = TRUE;
1444 }
1445
1446 if (r_type == R_AARCH64_NONE || r_type == R_AARCH64_NULL)
1447 return BFD_RELOC_AARCH64_NONE;
1448
1449 /* PR 17512: file: b371e70a. */
1450 if (r_type >= R_AARCH64_end)
1451 {
1452 _bfd_error_handler (_("Invalid AArch64 reloc number: %d"), r_type);
1453 bfd_set_error (bfd_error_bad_value);
1454 return BFD_RELOC_AARCH64_NONE;
1455 }
1456
1457 return BFD_RELOC_AARCH64_RELOC_START + offsets[r_type];
1458 }
1459
1460 struct elf_aarch64_reloc_map
1461 {
1462 bfd_reloc_code_real_type from;
1463 bfd_reloc_code_real_type to;
1464 };
1465
1466 /* Map bfd generic reloc to AArch64-specific reloc. */
1467 static const struct elf_aarch64_reloc_map elf_aarch64_reloc_map[] =
1468 {
1469 {BFD_RELOC_NONE, BFD_RELOC_AARCH64_NONE},
1470
1471 /* Basic data relocations. */
1472 {BFD_RELOC_CTOR, BFD_RELOC_AARCH64_NN},
1473 {BFD_RELOC_64, BFD_RELOC_AARCH64_64},
1474 {BFD_RELOC_32, BFD_RELOC_AARCH64_32},
1475 {BFD_RELOC_16, BFD_RELOC_AARCH64_16},
1476 {BFD_RELOC_64_PCREL, BFD_RELOC_AARCH64_64_PCREL},
1477 {BFD_RELOC_32_PCREL, BFD_RELOC_AARCH64_32_PCREL},
1478 {BFD_RELOC_16_PCREL, BFD_RELOC_AARCH64_16_PCREL},
1479 };
1480
1481 /* Given the bfd internal relocation enumerator in CODE, return the
1482 corresponding howto entry. */
1483
1484 static reloc_howto_type *
1485 elfNN_aarch64_howto_from_bfd_reloc (bfd_reloc_code_real_type code)
1486 {
1487 unsigned int i;
1488
1489 /* Convert bfd generic reloc to AArch64-specific reloc. */
1490 if (code < BFD_RELOC_AARCH64_RELOC_START
1491 || code > BFD_RELOC_AARCH64_RELOC_END)
1492 for (i = 0; i < ARRAY_SIZE (elf_aarch64_reloc_map); i++)
1493 if (elf_aarch64_reloc_map[i].from == code)
1494 {
1495 code = elf_aarch64_reloc_map[i].to;
1496 break;
1497 }
1498
1499 if (code > BFD_RELOC_AARCH64_RELOC_START
1500 && code < BFD_RELOC_AARCH64_RELOC_END)
1501 if (elfNN_aarch64_howto_table[code - BFD_RELOC_AARCH64_RELOC_START].type)
1502 return &elfNN_aarch64_howto_table[code - BFD_RELOC_AARCH64_RELOC_START];
1503
1504 if (code == BFD_RELOC_AARCH64_NONE)
1505 return &elfNN_aarch64_howto_none;
1506
1507 return NULL;
1508 }
1509
1510 static reloc_howto_type *
1511 elfNN_aarch64_howto_from_type (unsigned int r_type)
1512 {
1513 bfd_reloc_code_real_type val;
1514 reloc_howto_type *howto;
1515
1516 #if ARCH_SIZE == 32
1517 if (r_type > 256)
1518 {
1519 bfd_set_error (bfd_error_bad_value);
1520 return NULL;
1521 }
1522 #endif
1523
1524 if (r_type == R_AARCH64_NONE)
1525 return &elfNN_aarch64_howto_none;
1526
1527 val = elfNN_aarch64_bfd_reloc_from_type (r_type);
1528 howto = elfNN_aarch64_howto_from_bfd_reloc (val);
1529
1530 if (howto != NULL)
1531 return howto;
1532
1533 bfd_set_error (bfd_error_bad_value);
1534 return NULL;
1535 }
1536
1537 static void
1538 elfNN_aarch64_info_to_howto (bfd *abfd ATTRIBUTE_UNUSED, arelent *bfd_reloc,
1539 Elf_Internal_Rela *elf_reloc)
1540 {
1541 unsigned int r_type;
1542
1543 r_type = ELFNN_R_TYPE (elf_reloc->r_info);
1544 bfd_reloc->howto = elfNN_aarch64_howto_from_type (r_type);
1545 }
1546
1547 static reloc_howto_type *
1548 elfNN_aarch64_reloc_type_lookup (bfd *abfd ATTRIBUTE_UNUSED,
1549 bfd_reloc_code_real_type code)
1550 {
1551 reloc_howto_type *howto = elfNN_aarch64_howto_from_bfd_reloc (code);
1552
1553 if (howto != NULL)
1554 return howto;
1555
1556 bfd_set_error (bfd_error_bad_value);
1557 return NULL;
1558 }
1559
1560 static reloc_howto_type *
1561 elfNN_aarch64_reloc_name_lookup (bfd *abfd ATTRIBUTE_UNUSED,
1562 const char *r_name)
1563 {
1564 unsigned int i;
1565
1566 for (i = 1; i < ARRAY_SIZE (elfNN_aarch64_howto_table) - 1; ++i)
1567 if (elfNN_aarch64_howto_table[i].name != NULL
1568 && strcasecmp (elfNN_aarch64_howto_table[i].name, r_name) == 0)
1569 return &elfNN_aarch64_howto_table[i];
1570
1571 return NULL;
1572 }
1573
1574 #define TARGET_LITTLE_SYM aarch64_elfNN_le_vec
1575 #define TARGET_LITTLE_NAME "elfNN-littleaarch64"
1576 #define TARGET_BIG_SYM aarch64_elfNN_be_vec
1577 #define TARGET_BIG_NAME "elfNN-bigaarch64"
1578
1579 /* The linker script knows the section names for placement.
1580 The entry_names are used to do simple name mangling on the stubs.
1581 Given a function name, and its type, the stub can be found. The
1582 name can be changed. The only requirement is the %s be present. */
1583 #define STUB_ENTRY_NAME "__%s_veneer"
1584
1585 /* The name of the dynamic interpreter. This is put in the .interp
1586 section. */
1587 #define ELF_DYNAMIC_INTERPRETER "/lib/ld.so.1"
1588
1589 #define AARCH64_MAX_FWD_BRANCH_OFFSET \
1590 (((1 << 25) - 1) << 2)
1591 #define AARCH64_MAX_BWD_BRANCH_OFFSET \
1592 (-((1 << 25) << 2))
1593
1594 #define AARCH64_MAX_ADRP_IMM ((1 << 20) - 1)
1595 #define AARCH64_MIN_ADRP_IMM (-(1 << 20))
1596
1597 static int
1598 aarch64_valid_for_adrp_p (bfd_vma value, bfd_vma place)
1599 {
1600 bfd_signed_vma offset = (bfd_signed_vma) (PG (value) - PG (place)) >> 12;
1601 return offset <= AARCH64_MAX_ADRP_IMM && offset >= AARCH64_MIN_ADRP_IMM;
1602 }
1603
1604 static int
1605 aarch64_valid_branch_p (bfd_vma value, bfd_vma place)
1606 {
1607 bfd_signed_vma offset = (bfd_signed_vma) (value - place);
1608 return (offset <= AARCH64_MAX_FWD_BRANCH_OFFSET
1609 && offset >= AARCH64_MAX_BWD_BRANCH_OFFSET);
1610 }
1611
1612 static const uint32_t aarch64_adrp_branch_stub [] =
1613 {
1614 0x90000010, /* adrp ip0, X */
1615 /* R_AARCH64_ADR_HI21_PCREL(X) */
1616 0x91000210, /* add ip0, ip0, :lo12:X */
1617 /* R_AARCH64_ADD_ABS_LO12_NC(X) */
1618 0xd61f0200, /* br ip0 */
1619 };
1620
1621 static const uint32_t aarch64_long_branch_stub[] =
1622 {
1623 #if ARCH_SIZE == 64
1624 0x58000090, /* ldr ip0, 1f */
1625 #else
1626 0x18000090, /* ldr wip0, 1f */
1627 #endif
1628 0x10000011, /* adr ip1, #0 */
1629 0x8b110210, /* add ip0, ip0, ip1 */
1630 0xd61f0200, /* br ip0 */
1631 0x00000000, /* 1: .xword or .word
1632 R_AARCH64_PRELNN(X) + 12
1633 */
1634 0x00000000,
1635 };
1636
1637 static const uint32_t aarch64_erratum_835769_stub[] =
1638 {
1639 0x00000000, /* Placeholder for multiply accumulate. */
1640 0x14000000, /* b <label> */
1641 };
1642
1643 /* Section name for stubs is the associated section name plus this
1644 string. */
1645 #define STUB_SUFFIX ".stub"
1646
1647 enum elf_aarch64_stub_type
1648 {
1649 aarch64_stub_none,
1650 aarch64_stub_adrp_branch,
1651 aarch64_stub_long_branch,
1652 aarch64_stub_erratum_835769_veneer,
1653 };
1654
1655 struct elf_aarch64_stub_hash_entry
1656 {
1657 /* Base hash table entry structure. */
1658 struct bfd_hash_entry root;
1659
1660 /* The stub section. */
1661 asection *stub_sec;
1662
1663 /* Offset within stub_sec of the beginning of this stub. */
1664 bfd_vma stub_offset;
1665
1666 /* Given the symbol's value and its section we can determine its final
1667 value when building the stubs (so the stub knows where to jump). */
1668 bfd_vma target_value;
1669 asection *target_section;
1670
1671 enum elf_aarch64_stub_type stub_type;
1672
1673 /* The symbol table entry, if any, that this was derived from. */
1674 struct elf_aarch64_link_hash_entry *h;
1675
1676 /* Destination symbol type */
1677 unsigned char st_type;
1678
1679 /* Where this stub is being called from, or, in the case of combined
1680 stub sections, the first input section in the group. */
1681 asection *id_sec;
1682
1683 /* The name for the local symbol at the start of this stub. The
1684 stub name in the hash table has to be unique; this does not, so
1685 it can be friendlier. */
1686 char *output_name;
1687
1688 /* The instruction which caused this stub to be generated (only valid for
1689 erratum 835769 workaround stubs at present). */
1690 uint32_t veneered_insn;
1691 };
1692
1693 /* Used to build a map of a section. This is required for mixed-endian
1694 code/data. */
1695
1696 typedef struct elf_elf_section_map
1697 {
1698 bfd_vma vma;
1699 char type;
1700 }
1701 elf_aarch64_section_map;
1702
1703
1704 typedef struct _aarch64_elf_section_data
1705 {
1706 struct bfd_elf_section_data elf;
1707 unsigned int mapcount;
1708 unsigned int mapsize;
1709 elf_aarch64_section_map *map;
1710 }
1711 _aarch64_elf_section_data;
1712
1713 #define elf_aarch64_section_data(sec) \
1714 ((_aarch64_elf_section_data *) elf_section_data (sec))
1715
1716 /* A fix-descriptor for erratum 835769. */
1717 struct aarch64_erratum_835769_fix
1718 {
1719 bfd *input_bfd;
1720 asection *section;
1721 bfd_vma offset;
1722 uint32_t veneered_insn;
1723 char *stub_name;
1724 enum elf_aarch64_stub_type stub_type;
1725 };
1726
1727 /* The size of the thread control block which is defined to be two pointers. */
1728 #define TCB_SIZE (ARCH_SIZE/8)*2
1729
1730 struct elf_aarch64_local_symbol
1731 {
1732 unsigned int got_type;
1733 bfd_signed_vma got_refcount;
1734 bfd_vma got_offset;
1735
1736 /* Offset of the GOTPLT entry reserved for the TLS descriptor. The
1737 offset is from the end of the jump table and reserved entries
1738 within the PLTGOT.
1739
1740 The magic value (bfd_vma) -1 indicates that an offset has not be
1741 allocated. */
1742 bfd_vma tlsdesc_got_jump_table_offset;
1743 };
1744
1745 struct elf_aarch64_obj_tdata
1746 {
1747 struct elf_obj_tdata root;
1748
1749 /* local symbol descriptors */
1750 struct elf_aarch64_local_symbol *locals;
1751
1752 /* Zero to warn when linking objects with incompatible enum sizes. */
1753 int no_enum_size_warning;
1754
1755 /* Zero to warn when linking objects with incompatible wchar_t sizes. */
1756 int no_wchar_size_warning;
1757 };
1758
1759 #define elf_aarch64_tdata(bfd) \
1760 ((struct elf_aarch64_obj_tdata *) (bfd)->tdata.any)
1761
1762 #define elf_aarch64_locals(bfd) (elf_aarch64_tdata (bfd)->locals)
1763
1764 #define is_aarch64_elf(bfd) \
1765 (bfd_get_flavour (bfd) == bfd_target_elf_flavour \
1766 && elf_tdata (bfd) != NULL \
1767 && elf_object_id (bfd) == AARCH64_ELF_DATA)
1768
1769 static bfd_boolean
1770 elfNN_aarch64_mkobject (bfd *abfd)
1771 {
1772 return bfd_elf_allocate_object (abfd, sizeof (struct elf_aarch64_obj_tdata),
1773 AARCH64_ELF_DATA);
1774 }
1775
1776 #define elf_aarch64_hash_entry(ent) \
1777 ((struct elf_aarch64_link_hash_entry *)(ent))
1778
1779 #define GOT_UNKNOWN 0
1780 #define GOT_NORMAL 1
1781 #define GOT_TLS_GD 2
1782 #define GOT_TLS_IE 4
1783 #define GOT_TLSDESC_GD 8
1784
1785 #define GOT_TLS_GD_ANY_P(type) ((type & GOT_TLS_GD) || (type & GOT_TLSDESC_GD))
1786
1787 /* AArch64 ELF linker hash entry. */
1788 struct elf_aarch64_link_hash_entry
1789 {
1790 struct elf_link_hash_entry root;
1791
1792 /* Track dynamic relocs copied for this symbol. */
1793 struct elf_dyn_relocs *dyn_relocs;
1794
1795 /* Since PLT entries have variable size, we need to record the
1796 index into .got.plt instead of recomputing it from the PLT
1797 offset. */
1798 bfd_signed_vma plt_got_offset;
1799
1800 /* Bit mask representing the type of GOT entry(s) if any required by
1801 this symbol. */
1802 unsigned int got_type;
1803
1804 /* A pointer to the most recently used stub hash entry against this
1805 symbol. */
1806 struct elf_aarch64_stub_hash_entry *stub_cache;
1807
1808 /* Offset of the GOTPLT entry reserved for the TLS descriptor. The offset
1809 is from the end of the jump table and reserved entries within the PLTGOT.
1810
1811 The magic value (bfd_vma) -1 indicates that an offset has not
1812 be allocated. */
1813 bfd_vma tlsdesc_got_jump_table_offset;
1814 };
1815
1816 static unsigned int
1817 elfNN_aarch64_symbol_got_type (struct elf_link_hash_entry *h,
1818 bfd *abfd,
1819 unsigned long r_symndx)
1820 {
1821 if (h)
1822 return elf_aarch64_hash_entry (h)->got_type;
1823
1824 if (! elf_aarch64_locals (abfd))
1825 return GOT_UNKNOWN;
1826
1827 return elf_aarch64_locals (abfd)[r_symndx].got_type;
1828 }
1829
1830 /* Get the AArch64 elf linker hash table from a link_info structure. */
1831 #define elf_aarch64_hash_table(info) \
1832 ((struct elf_aarch64_link_hash_table *) ((info)->hash))
1833
1834 #define aarch64_stub_hash_lookup(table, string, create, copy) \
1835 ((struct elf_aarch64_stub_hash_entry *) \
1836 bfd_hash_lookup ((table), (string), (create), (copy)))
1837
1838 /* AArch64 ELF linker hash table. */
1839 struct elf_aarch64_link_hash_table
1840 {
1841 /* The main hash table. */
1842 struct elf_link_hash_table root;
1843
1844 /* Nonzero to force PIC branch veneers. */
1845 int pic_veneer;
1846
1847 /* Fix erratum 835769. */
1848 int fix_erratum_835769;
1849
1850 /* The number of bytes in the initial entry in the PLT. */
1851 bfd_size_type plt_header_size;
1852
1853 /* The number of bytes in the subsequent PLT etries. */
1854 bfd_size_type plt_entry_size;
1855
1856 /* Short-cuts to get to dynamic linker sections. */
1857 asection *sdynbss;
1858 asection *srelbss;
1859
1860 /* Small local sym cache. */
1861 struct sym_cache sym_cache;
1862
1863 /* For convenience in allocate_dynrelocs. */
1864 bfd *obfd;
1865
1866 /* The amount of space used by the reserved portion of the sgotplt
1867 section, plus whatever space is used by the jump slots. */
1868 bfd_vma sgotplt_jump_table_size;
1869
1870 /* The stub hash table. */
1871 struct bfd_hash_table stub_hash_table;
1872
1873 /* Linker stub bfd. */
1874 bfd *stub_bfd;
1875
1876 /* Linker call-backs. */
1877 asection *(*add_stub_section) (const char *, asection *);
1878 void (*layout_sections_again) (void);
1879
1880 /* Array to keep track of which stub sections have been created, and
1881 information on stub grouping. */
1882 struct map_stub
1883 {
1884 /* This is the section to which stubs in the group will be
1885 attached. */
1886 asection *link_sec;
1887 /* The stub section. */
1888 asection *stub_sec;
1889 } *stub_group;
1890
1891 /* Assorted information used by elfNN_aarch64_size_stubs. */
1892 unsigned int bfd_count;
1893 int top_index;
1894 asection **input_list;
1895
1896 /* The offset into splt of the PLT entry for the TLS descriptor
1897 resolver. Special values are 0, if not necessary (or not found
1898 to be necessary yet), and -1 if needed but not determined
1899 yet. */
1900 bfd_vma tlsdesc_plt;
1901
1902 /* The GOT offset for the lazy trampoline. Communicated to the
1903 loader via DT_TLSDESC_GOT. The magic value (bfd_vma) -1
1904 indicates an offset is not allocated. */
1905 bfd_vma dt_tlsdesc_got;
1906
1907 /* Used by local STT_GNU_IFUNC symbols. */
1908 htab_t loc_hash_table;
1909 void * loc_hash_memory;
1910 };
1911
1912 /* Create an entry in an AArch64 ELF linker hash table. */
1913
1914 static struct bfd_hash_entry *
1915 elfNN_aarch64_link_hash_newfunc (struct bfd_hash_entry *entry,
1916 struct bfd_hash_table *table,
1917 const char *string)
1918 {
1919 struct elf_aarch64_link_hash_entry *ret =
1920 (struct elf_aarch64_link_hash_entry *) entry;
1921
1922 /* Allocate the structure if it has not already been allocated by a
1923 subclass. */
1924 if (ret == NULL)
1925 ret = bfd_hash_allocate (table,
1926 sizeof (struct elf_aarch64_link_hash_entry));
1927 if (ret == NULL)
1928 return (struct bfd_hash_entry *) ret;
1929
1930 /* Call the allocation method of the superclass. */
1931 ret = ((struct elf_aarch64_link_hash_entry *)
1932 _bfd_elf_link_hash_newfunc ((struct bfd_hash_entry *) ret,
1933 table, string));
1934 if (ret != NULL)
1935 {
1936 ret->dyn_relocs = NULL;
1937 ret->got_type = GOT_UNKNOWN;
1938 ret->plt_got_offset = (bfd_vma) - 1;
1939 ret->stub_cache = NULL;
1940 ret->tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
1941 }
1942
1943 return (struct bfd_hash_entry *) ret;
1944 }
1945
1946 /* Initialize an entry in the stub hash table. */
1947
1948 static struct bfd_hash_entry *
1949 stub_hash_newfunc (struct bfd_hash_entry *entry,
1950 struct bfd_hash_table *table, const char *string)
1951 {
1952 /* Allocate the structure if it has not already been allocated by a
1953 subclass. */
1954 if (entry == NULL)
1955 {
1956 entry = bfd_hash_allocate (table,
1957 sizeof (struct
1958 elf_aarch64_stub_hash_entry));
1959 if (entry == NULL)
1960 return entry;
1961 }
1962
1963 /* Call the allocation method of the superclass. */
1964 entry = bfd_hash_newfunc (entry, table, string);
1965 if (entry != NULL)
1966 {
1967 struct elf_aarch64_stub_hash_entry *eh;
1968
1969 /* Initialize the local fields. */
1970 eh = (struct elf_aarch64_stub_hash_entry *) entry;
1971 eh->stub_sec = NULL;
1972 eh->stub_offset = 0;
1973 eh->target_value = 0;
1974 eh->target_section = NULL;
1975 eh->stub_type = aarch64_stub_none;
1976 eh->h = NULL;
1977 eh->id_sec = NULL;
1978 }
1979
1980 return entry;
1981 }
1982
1983 /* Compute a hash of a local hash entry. We use elf_link_hash_entry
1984 for local symbol so that we can handle local STT_GNU_IFUNC symbols
1985 as global symbol. We reuse indx and dynstr_index for local symbol
1986 hash since they aren't used by global symbols in this backend. */
1987
1988 static hashval_t
1989 elfNN_aarch64_local_htab_hash (const void *ptr)
1990 {
1991 struct elf_link_hash_entry *h
1992 = (struct elf_link_hash_entry *) ptr;
1993 return ELF_LOCAL_SYMBOL_HASH (h->indx, h->dynstr_index);
1994 }
1995
1996 /* Compare local hash entries. */
1997
1998 static int
1999 elfNN_aarch64_local_htab_eq (const void *ptr1, const void *ptr2)
2000 {
2001 struct elf_link_hash_entry *h1
2002 = (struct elf_link_hash_entry *) ptr1;
2003 struct elf_link_hash_entry *h2
2004 = (struct elf_link_hash_entry *) ptr2;
2005
2006 return h1->indx == h2->indx && h1->dynstr_index == h2->dynstr_index;
2007 }
2008
2009 /* Find and/or create a hash entry for local symbol. */
2010
2011 static struct elf_link_hash_entry *
2012 elfNN_aarch64_get_local_sym_hash (struct elf_aarch64_link_hash_table *htab,
2013 bfd *abfd, const Elf_Internal_Rela *rel,
2014 bfd_boolean create)
2015 {
2016 struct elf_aarch64_link_hash_entry e, *ret;
2017 asection *sec = abfd->sections;
2018 hashval_t h = ELF_LOCAL_SYMBOL_HASH (sec->id,
2019 ELFNN_R_SYM (rel->r_info));
2020 void **slot;
2021
2022 e.root.indx = sec->id;
2023 e.root.dynstr_index = ELFNN_R_SYM (rel->r_info);
2024 slot = htab_find_slot_with_hash (htab->loc_hash_table, &e, h,
2025 create ? INSERT : NO_INSERT);
2026
2027 if (!slot)
2028 return NULL;
2029
2030 if (*slot)
2031 {
2032 ret = (struct elf_aarch64_link_hash_entry *) *slot;
2033 return &ret->root;
2034 }
2035
2036 ret = (struct elf_aarch64_link_hash_entry *)
2037 objalloc_alloc ((struct objalloc *) htab->loc_hash_memory,
2038 sizeof (struct elf_aarch64_link_hash_entry));
2039 if (ret)
2040 {
2041 memset (ret, 0, sizeof (*ret));
2042 ret->root.indx = sec->id;
2043 ret->root.dynstr_index = ELFNN_R_SYM (rel->r_info);
2044 ret->root.dynindx = -1;
2045 *slot = ret;
2046 }
2047 return &ret->root;
2048 }
2049
2050 /* Copy the extra info we tack onto an elf_link_hash_entry. */
2051
2052 static void
2053 elfNN_aarch64_copy_indirect_symbol (struct bfd_link_info *info,
2054 struct elf_link_hash_entry *dir,
2055 struct elf_link_hash_entry *ind)
2056 {
2057 struct elf_aarch64_link_hash_entry *edir, *eind;
2058
2059 edir = (struct elf_aarch64_link_hash_entry *) dir;
2060 eind = (struct elf_aarch64_link_hash_entry *) ind;
2061
2062 if (eind->dyn_relocs != NULL)
2063 {
2064 if (edir->dyn_relocs != NULL)
2065 {
2066 struct elf_dyn_relocs **pp;
2067 struct elf_dyn_relocs *p;
2068
2069 /* Add reloc counts against the indirect sym to the direct sym
2070 list. Merge any entries against the same section. */
2071 for (pp = &eind->dyn_relocs; (p = *pp) != NULL;)
2072 {
2073 struct elf_dyn_relocs *q;
2074
2075 for (q = edir->dyn_relocs; q != NULL; q = q->next)
2076 if (q->sec == p->sec)
2077 {
2078 q->pc_count += p->pc_count;
2079 q->count += p->count;
2080 *pp = p->next;
2081 break;
2082 }
2083 if (q == NULL)
2084 pp = &p->next;
2085 }
2086 *pp = edir->dyn_relocs;
2087 }
2088
2089 edir->dyn_relocs = eind->dyn_relocs;
2090 eind->dyn_relocs = NULL;
2091 }
2092
2093 if (ind->root.type == bfd_link_hash_indirect)
2094 {
2095 /* Copy over PLT info. */
2096 if (dir->got.refcount <= 0)
2097 {
2098 edir->got_type = eind->got_type;
2099 eind->got_type = GOT_UNKNOWN;
2100 }
2101 }
2102
2103 _bfd_elf_link_hash_copy_indirect (info, dir, ind);
2104 }
2105
2106 /* Destroy an AArch64 elf linker hash table. */
2107
2108 static void
2109 elfNN_aarch64_link_hash_table_free (bfd *obfd)
2110 {
2111 struct elf_aarch64_link_hash_table *ret
2112 = (struct elf_aarch64_link_hash_table *) obfd->link.hash;
2113
2114 if (ret->loc_hash_table)
2115 htab_delete (ret->loc_hash_table);
2116 if (ret->loc_hash_memory)
2117 objalloc_free ((struct objalloc *) ret->loc_hash_memory);
2118
2119 bfd_hash_table_free (&ret->stub_hash_table);
2120 _bfd_elf_link_hash_table_free (obfd);
2121 }
2122
2123 /* Create an AArch64 elf linker hash table. */
2124
2125 static struct bfd_link_hash_table *
2126 elfNN_aarch64_link_hash_table_create (bfd *abfd)
2127 {
2128 struct elf_aarch64_link_hash_table *ret;
2129 bfd_size_type amt = sizeof (struct elf_aarch64_link_hash_table);
2130
2131 ret = bfd_zmalloc (amt);
2132 if (ret == NULL)
2133 return NULL;
2134
2135 if (!_bfd_elf_link_hash_table_init
2136 (&ret->root, abfd, elfNN_aarch64_link_hash_newfunc,
2137 sizeof (struct elf_aarch64_link_hash_entry), AARCH64_ELF_DATA))
2138 {
2139 free (ret);
2140 return NULL;
2141 }
2142
2143 ret->plt_header_size = PLT_ENTRY_SIZE;
2144 ret->plt_entry_size = PLT_SMALL_ENTRY_SIZE;
2145 ret->obfd = abfd;
2146 ret->dt_tlsdesc_got = (bfd_vma) - 1;
2147
2148 if (!bfd_hash_table_init (&ret->stub_hash_table, stub_hash_newfunc,
2149 sizeof (struct elf_aarch64_stub_hash_entry)))
2150 {
2151 _bfd_elf_link_hash_table_free (abfd);
2152 return NULL;
2153 }
2154
2155 ret->loc_hash_table = htab_try_create (1024,
2156 elfNN_aarch64_local_htab_hash,
2157 elfNN_aarch64_local_htab_eq,
2158 NULL);
2159 ret->loc_hash_memory = objalloc_create ();
2160 if (!ret->loc_hash_table || !ret->loc_hash_memory)
2161 {
2162 elfNN_aarch64_link_hash_table_free (abfd);
2163 return NULL;
2164 }
2165 ret->root.root.hash_table_free = elfNN_aarch64_link_hash_table_free;
2166
2167 return &ret->root.root;
2168 }
2169
2170 static bfd_boolean
2171 aarch64_relocate (unsigned int r_type, bfd *input_bfd, asection *input_section,
2172 bfd_vma offset, bfd_vma value)
2173 {
2174 reloc_howto_type *howto;
2175 bfd_vma place;
2176
2177 howto = elfNN_aarch64_howto_from_type (r_type);
2178 place = (input_section->output_section->vma + input_section->output_offset
2179 + offset);
2180
2181 r_type = elfNN_aarch64_bfd_reloc_from_type (r_type);
2182 value = _bfd_aarch64_elf_resolve_relocation (r_type, place, value, 0, FALSE);
2183 return _bfd_aarch64_elf_put_addend (input_bfd,
2184 input_section->contents + offset, r_type,
2185 howto, value);
2186 }
2187
2188 static enum elf_aarch64_stub_type
2189 aarch64_select_branch_stub (bfd_vma value, bfd_vma place)
2190 {
2191 if (aarch64_valid_for_adrp_p (value, place))
2192 return aarch64_stub_adrp_branch;
2193 return aarch64_stub_long_branch;
2194 }
2195
2196 /* Determine the type of stub needed, if any, for a call. */
2197
2198 static enum elf_aarch64_stub_type
2199 aarch64_type_of_stub (struct bfd_link_info *info,
2200 asection *input_sec,
2201 const Elf_Internal_Rela *rel,
2202 unsigned char st_type,
2203 struct elf_aarch64_link_hash_entry *hash,
2204 bfd_vma destination)
2205 {
2206 bfd_vma location;
2207 bfd_signed_vma branch_offset;
2208 unsigned int r_type;
2209 struct elf_aarch64_link_hash_table *globals;
2210 enum elf_aarch64_stub_type stub_type = aarch64_stub_none;
2211 bfd_boolean via_plt_p;
2212
2213 if (st_type != STT_FUNC)
2214 return stub_type;
2215
2216 globals = elf_aarch64_hash_table (info);
2217 via_plt_p = (globals->root.splt != NULL && hash != NULL
2218 && hash->root.plt.offset != (bfd_vma) - 1);
2219
2220 if (via_plt_p)
2221 return stub_type;
2222
2223 /* Determine where the call point is. */
2224 location = (input_sec->output_offset
2225 + input_sec->output_section->vma + rel->r_offset);
2226
2227 branch_offset = (bfd_signed_vma) (destination - location);
2228
2229 r_type = ELFNN_R_TYPE (rel->r_info);
2230
2231 /* We don't want to redirect any old unconditional jump in this way,
2232 only one which is being used for a sibcall, where it is
2233 acceptable for the IP0 and IP1 registers to be clobbered. */
2234 if ((r_type == AARCH64_R (CALL26) || r_type == AARCH64_R (JUMP26))
2235 && (branch_offset > AARCH64_MAX_FWD_BRANCH_OFFSET
2236 || branch_offset < AARCH64_MAX_BWD_BRANCH_OFFSET))
2237 {
2238 stub_type = aarch64_stub_long_branch;
2239 }
2240
2241 return stub_type;
2242 }
2243
2244 /* Build a name for an entry in the stub hash table. */
2245
2246 static char *
2247 elfNN_aarch64_stub_name (const asection *input_section,
2248 const asection *sym_sec,
2249 const struct elf_aarch64_link_hash_entry *hash,
2250 const Elf_Internal_Rela *rel)
2251 {
2252 char *stub_name;
2253 bfd_size_type len;
2254
2255 if (hash)
2256 {
2257 len = 8 + 1 + strlen (hash->root.root.root.string) + 1 + 16 + 1;
2258 stub_name = bfd_malloc (len);
2259 if (stub_name != NULL)
2260 snprintf (stub_name, len, "%08x_%s+%" BFD_VMA_FMT "x",
2261 (unsigned int) input_section->id,
2262 hash->root.root.root.string,
2263 rel->r_addend);
2264 }
2265 else
2266 {
2267 len = 8 + 1 + 8 + 1 + 8 + 1 + 16 + 1;
2268 stub_name = bfd_malloc (len);
2269 if (stub_name != NULL)
2270 snprintf (stub_name, len, "%08x_%x:%x+%" BFD_VMA_FMT "x",
2271 (unsigned int) input_section->id,
2272 (unsigned int) sym_sec->id,
2273 (unsigned int) ELFNN_R_SYM (rel->r_info),
2274 rel->r_addend);
2275 }
2276
2277 return stub_name;
2278 }
2279
2280 /* Look up an entry in the stub hash. Stub entries are cached because
2281 creating the stub name takes a bit of time. */
2282
2283 static struct elf_aarch64_stub_hash_entry *
2284 elfNN_aarch64_get_stub_entry (const asection *input_section,
2285 const asection *sym_sec,
2286 struct elf_link_hash_entry *hash,
2287 const Elf_Internal_Rela *rel,
2288 struct elf_aarch64_link_hash_table *htab)
2289 {
2290 struct elf_aarch64_stub_hash_entry *stub_entry;
2291 struct elf_aarch64_link_hash_entry *h =
2292 (struct elf_aarch64_link_hash_entry *) hash;
2293 const asection *id_sec;
2294
2295 if ((input_section->flags & SEC_CODE) == 0)
2296 return NULL;
2297
2298 /* If this input section is part of a group of sections sharing one
2299 stub section, then use the id of the first section in the group.
2300 Stub names need to include a section id, as there may well be
2301 more than one stub used to reach say, printf, and we need to
2302 distinguish between them. */
2303 id_sec = htab->stub_group[input_section->id].link_sec;
2304
2305 if (h != NULL && h->stub_cache != NULL
2306 && h->stub_cache->h == h && h->stub_cache->id_sec == id_sec)
2307 {
2308 stub_entry = h->stub_cache;
2309 }
2310 else
2311 {
2312 char *stub_name;
2313
2314 stub_name = elfNN_aarch64_stub_name (id_sec, sym_sec, h, rel);
2315 if (stub_name == NULL)
2316 return NULL;
2317
2318 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table,
2319 stub_name, FALSE, FALSE);
2320 if (h != NULL)
2321 h->stub_cache = stub_entry;
2322
2323 free (stub_name);
2324 }
2325
2326 return stub_entry;
2327 }
2328
2329
2330 /* Create a stub section. */
2331
2332 static asection *
2333 _bfd_aarch64_create_stub_section (asection *section,
2334 struct elf_aarch64_link_hash_table *htab)
2335 {
2336 size_t namelen;
2337 bfd_size_type len;
2338 char *s_name;
2339
2340 namelen = strlen (section->name);
2341 len = namelen + sizeof (STUB_SUFFIX);
2342 s_name = bfd_alloc (htab->stub_bfd, len);
2343 if (s_name == NULL)
2344 return NULL;
2345
2346 memcpy (s_name, section->name, namelen);
2347 memcpy (s_name + namelen, STUB_SUFFIX, sizeof (STUB_SUFFIX));
2348 return (*htab->add_stub_section) (s_name, section);
2349 }
2350
2351
2352 /* Find or create a stub section in the stub group for an input
2353 section. */
2354
2355 static asection *
2356 _bfd_aarch64_create_or_find_stub_sec (asection *section,
2357 struct elf_aarch64_link_hash_table *htab)
2358 {
2359 asection *link_sec;
2360 asection *stub_sec;
2361
2362 link_sec = htab->stub_group[section->id].link_sec;
2363 BFD_ASSERT (link_sec != NULL);
2364 stub_sec = htab->stub_group[section->id].stub_sec;
2365
2366 if (stub_sec == NULL)
2367 {
2368 stub_sec = htab->stub_group[link_sec->id].stub_sec;
2369 if (stub_sec == NULL)
2370 {
2371 stub_sec = _bfd_aarch64_create_stub_section (link_sec, htab)
2372 if (stub_sec == NULL)
2373 return NULL;
2374 htab->stub_group[link_sec->id].stub_sec = stub_sec;
2375 }
2376 htab->stub_group[section->id].stub_sec = stub_sec;
2377 }
2378
2379 return stub_sec;
2380 }
2381
2382
2383 /* Add a new stub entry in the stub group associated with an input
2384 section to the stub hash. Not all fields of the new stub entry are
2385 initialised. */
2386
2387 static struct elf_aarch64_stub_hash_entry *
2388 _bfd_aarch64_add_stub_entry_in_group (const char *stub_name,
2389 asection *section,
2390 struct elf_aarch64_link_hash_table *htab)
2391 {
2392 asection *link_sec;
2393 asection *stub_sec;
2394 struct elf_aarch64_stub_hash_entry *stub_entry;
2395
2396 link_sec = htab->stub_group[section->id].link_sec;
2397 stub_sec = _bfd_aarch64_create_or_find_stub_sec (section, htab);
2398
2399 /* Enter this entry into the linker stub hash table. */
2400 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table, stub_name,
2401 TRUE, FALSE);
2402 if (stub_entry == NULL)
2403 {
2404 (*_bfd_error_handler) (_("%s: cannot create stub entry %s"),
2405 section->owner, stub_name);
2406 return NULL;
2407 }
2408
2409 stub_entry->stub_sec = stub_sec;
2410 stub_entry->stub_offset = 0;
2411 stub_entry->id_sec = link_sec;
2412
2413 return stub_entry;
2414 }
2415
2416 static bfd_boolean
2417 aarch64_build_one_stub (struct bfd_hash_entry *gen_entry,
2418 void *in_arg ATTRIBUTE_UNUSED)
2419 {
2420 struct elf_aarch64_stub_hash_entry *stub_entry;
2421 asection *stub_sec;
2422 bfd *stub_bfd;
2423 bfd_byte *loc;
2424 bfd_vma sym_value;
2425 bfd_vma veneered_insn_loc;
2426 bfd_vma veneer_entry_loc;
2427 bfd_signed_vma branch_offset = 0;
2428 unsigned int template_size;
2429 const uint32_t *template;
2430 unsigned int i;
2431
2432 /* Massage our args to the form they really have. */
2433 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
2434
2435 stub_sec = stub_entry->stub_sec;
2436
2437 /* Make a note of the offset within the stubs for this entry. */
2438 stub_entry->stub_offset = stub_sec->size;
2439 loc = stub_sec->contents + stub_entry->stub_offset;
2440
2441 stub_bfd = stub_sec->owner;
2442
2443 /* This is the address of the stub destination. */
2444 sym_value = (stub_entry->target_value
2445 + stub_entry->target_section->output_offset
2446 + stub_entry->target_section->output_section->vma);
2447
2448 if (stub_entry->stub_type == aarch64_stub_long_branch)
2449 {
2450 bfd_vma place = (stub_entry->stub_offset + stub_sec->output_section->vma
2451 + stub_sec->output_offset);
2452
2453 /* See if we can relax the stub. */
2454 if (aarch64_valid_for_adrp_p (sym_value, place))
2455 stub_entry->stub_type = aarch64_select_branch_stub (sym_value, place);
2456 }
2457
2458 switch (stub_entry->stub_type)
2459 {
2460 case aarch64_stub_adrp_branch:
2461 template = aarch64_adrp_branch_stub;
2462 template_size = sizeof (aarch64_adrp_branch_stub);
2463 break;
2464 case aarch64_stub_long_branch:
2465 template = aarch64_long_branch_stub;
2466 template_size = sizeof (aarch64_long_branch_stub);
2467 break;
2468 case aarch64_stub_erratum_835769_veneer:
2469 template = aarch64_erratum_835769_stub;
2470 template_size = sizeof (aarch64_erratum_835769_stub);
2471 break;
2472 default:
2473 abort ();
2474 }
2475
2476 for (i = 0; i < (template_size / sizeof template[0]); i++)
2477 {
2478 bfd_putl32 (template[i], loc);
2479 loc += 4;
2480 }
2481
2482 template_size = (template_size + 7) & ~7;
2483 stub_sec->size += template_size;
2484
2485 switch (stub_entry->stub_type)
2486 {
2487 case aarch64_stub_adrp_branch:
2488 if (aarch64_relocate (AARCH64_R (ADR_PREL_PG_HI21), stub_bfd, stub_sec,
2489 stub_entry->stub_offset, sym_value))
2490 /* The stub would not have been relaxed if the offset was out
2491 of range. */
2492 BFD_FAIL ();
2493
2494 _bfd_final_link_relocate
2495 (elfNN_aarch64_howto_from_type (AARCH64_R (ADD_ABS_LO12_NC)),
2496 stub_bfd,
2497 stub_sec,
2498 stub_sec->contents,
2499 stub_entry->stub_offset + 4,
2500 sym_value,
2501 0);
2502 break;
2503
2504 case aarch64_stub_long_branch:
2505 /* We want the value relative to the address 12 bytes back from the
2506 value itself. */
2507 _bfd_final_link_relocate (elfNN_aarch64_howto_from_type
2508 (AARCH64_R (PRELNN)), stub_bfd, stub_sec,
2509 stub_sec->contents,
2510 stub_entry->stub_offset + 16,
2511 sym_value + 12, 0);
2512 break;
2513
2514 case aarch64_stub_erratum_835769_veneer:
2515 veneered_insn_loc = stub_entry->target_section->output_section->vma
2516 + stub_entry->target_section->output_offset
2517 + stub_entry->target_value;
2518 veneer_entry_loc = stub_entry->stub_sec->output_section->vma
2519 + stub_entry->stub_sec->output_offset
2520 + stub_entry->stub_offset;
2521 branch_offset = veneered_insn_loc - veneer_entry_loc;
2522 branch_offset >>= 2;
2523 branch_offset &= 0x3ffffff;
2524 bfd_putl32 (stub_entry->veneered_insn,
2525 stub_sec->contents + stub_entry->stub_offset);
2526 bfd_putl32 (template[1] | branch_offset,
2527 stub_sec->contents + stub_entry->stub_offset + 4);
2528 break;
2529
2530 default:
2531 abort ();
2532 }
2533
2534 return TRUE;
2535 }
2536
2537 /* As above, but don't actually build the stub. Just bump offset so
2538 we know stub section sizes. */
2539
2540 static bfd_boolean
2541 aarch64_size_one_stub (struct bfd_hash_entry *gen_entry,
2542 void *in_arg ATTRIBUTE_UNUSED)
2543 {
2544 struct elf_aarch64_stub_hash_entry *stub_entry;
2545 int size;
2546
2547 /* Massage our args to the form they really have. */
2548 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
2549
2550 switch (stub_entry->stub_type)
2551 {
2552 case aarch64_stub_adrp_branch:
2553 size = sizeof (aarch64_adrp_branch_stub);
2554 break;
2555 case aarch64_stub_long_branch:
2556 size = sizeof (aarch64_long_branch_stub);
2557 break;
2558 case aarch64_stub_erratum_835769_veneer:
2559 size = sizeof (aarch64_erratum_835769_stub);
2560 break;
2561 default:
2562 abort ();
2563 }
2564
2565 size = (size + 7) & ~7;
2566 stub_entry->stub_sec->size += size;
2567 return TRUE;
2568 }
2569
2570 /* External entry points for sizing and building linker stubs. */
2571
2572 /* Set up various things so that we can make a list of input sections
2573 for each output section included in the link. Returns -1 on error,
2574 0 when no stubs will be needed, and 1 on success. */
2575
2576 int
2577 elfNN_aarch64_setup_section_lists (bfd *output_bfd,
2578 struct bfd_link_info *info)
2579 {
2580 bfd *input_bfd;
2581 unsigned int bfd_count;
2582 int top_id, top_index;
2583 asection *section;
2584 asection **input_list, **list;
2585 bfd_size_type amt;
2586 struct elf_aarch64_link_hash_table *htab =
2587 elf_aarch64_hash_table (info);
2588
2589 if (!is_elf_hash_table (htab))
2590 return 0;
2591
2592 /* Count the number of input BFDs and find the top input section id. */
2593 for (input_bfd = info->input_bfds, bfd_count = 0, top_id = 0;
2594 input_bfd != NULL; input_bfd = input_bfd->link.next)
2595 {
2596 bfd_count += 1;
2597 for (section = input_bfd->sections;
2598 section != NULL; section = section->next)
2599 {
2600 if (top_id < section->id)
2601 top_id = section->id;
2602 }
2603 }
2604 htab->bfd_count = bfd_count;
2605
2606 amt = sizeof (struct map_stub) * (top_id + 1);
2607 htab->stub_group = bfd_zmalloc (amt);
2608 if (htab->stub_group == NULL)
2609 return -1;
2610
2611 /* We can't use output_bfd->section_count here to find the top output
2612 section index as some sections may have been removed, and
2613 _bfd_strip_section_from_output doesn't renumber the indices. */
2614 for (section = output_bfd->sections, top_index = 0;
2615 section != NULL; section = section->next)
2616 {
2617 if (top_index < section->index)
2618 top_index = section->index;
2619 }
2620
2621 htab->top_index = top_index;
2622 amt = sizeof (asection *) * (top_index + 1);
2623 input_list = bfd_malloc (amt);
2624 htab->input_list = input_list;
2625 if (input_list == NULL)
2626 return -1;
2627
2628 /* For sections we aren't interested in, mark their entries with a
2629 value we can check later. */
2630 list = input_list + top_index;
2631 do
2632 *list = bfd_abs_section_ptr;
2633 while (list-- != input_list);
2634
2635 for (section = output_bfd->sections;
2636 section != NULL; section = section->next)
2637 {
2638 if ((section->flags & SEC_CODE) != 0)
2639 input_list[section->index] = NULL;
2640 }
2641
2642 return 1;
2643 }
2644
2645 /* Used by elfNN_aarch64_next_input_section and group_sections. */
2646 #define PREV_SEC(sec) (htab->stub_group[(sec)->id].link_sec)
2647
2648 /* The linker repeatedly calls this function for each input section,
2649 in the order that input sections are linked into output sections.
2650 Build lists of input sections to determine groupings between which
2651 we may insert linker stubs. */
2652
2653 void
2654 elfNN_aarch64_next_input_section (struct bfd_link_info *info, asection *isec)
2655 {
2656 struct elf_aarch64_link_hash_table *htab =
2657 elf_aarch64_hash_table (info);
2658
2659 if (isec->output_section->index <= htab->top_index)
2660 {
2661 asection **list = htab->input_list + isec->output_section->index;
2662
2663 if (*list != bfd_abs_section_ptr)
2664 {
2665 /* Steal the link_sec pointer for our list. */
2666 /* This happens to make the list in reverse order,
2667 which is what we want. */
2668 PREV_SEC (isec) = *list;
2669 *list = isec;
2670 }
2671 }
2672 }
2673
2674 /* See whether we can group stub sections together. Grouping stub
2675 sections may result in fewer stubs. More importantly, we need to
2676 put all .init* and .fini* stubs at the beginning of the .init or
2677 .fini output sections respectively, because glibc splits the
2678 _init and _fini functions into multiple parts. Putting a stub in
2679 the middle of a function is not a good idea. */
2680
2681 static void
2682 group_sections (struct elf_aarch64_link_hash_table *htab,
2683 bfd_size_type stub_group_size,
2684 bfd_boolean stubs_always_before_branch)
2685 {
2686 asection **list = htab->input_list + htab->top_index;
2687
2688 do
2689 {
2690 asection *tail = *list;
2691
2692 if (tail == bfd_abs_section_ptr)
2693 continue;
2694
2695 while (tail != NULL)
2696 {
2697 asection *curr;
2698 asection *prev;
2699 bfd_size_type total;
2700
2701 curr = tail;
2702 total = tail->size;
2703 while ((prev = PREV_SEC (curr)) != NULL
2704 && ((total += curr->output_offset - prev->output_offset)
2705 < stub_group_size))
2706 curr = prev;
2707
2708 /* OK, the size from the start of CURR to the end is less
2709 than stub_group_size and thus can be handled by one stub
2710 section. (Or the tail section is itself larger than
2711 stub_group_size, in which case we may be toast.)
2712 We should really be keeping track of the total size of
2713 stubs added here, as stubs contribute to the final output
2714 section size. */
2715 do
2716 {
2717 prev = PREV_SEC (tail);
2718 /* Set up this stub group. */
2719 htab->stub_group[tail->id].link_sec = curr;
2720 }
2721 while (tail != curr && (tail = prev) != NULL);
2722
2723 /* But wait, there's more! Input sections up to stub_group_size
2724 bytes before the stub section can be handled by it too. */
2725 if (!stubs_always_before_branch)
2726 {
2727 total = 0;
2728 while (prev != NULL
2729 && ((total += tail->output_offset - prev->output_offset)
2730 < stub_group_size))
2731 {
2732 tail = prev;
2733 prev = PREV_SEC (tail);
2734 htab->stub_group[tail->id].link_sec = curr;
2735 }
2736 }
2737 tail = prev;
2738 }
2739 }
2740 while (list-- != htab->input_list);
2741
2742 free (htab->input_list);
2743 }
2744
2745 #undef PREV_SEC
2746
2747 #define AARCH64_BITS(x, pos, n) (((x) >> (pos)) & ((1 << (n)) - 1))
2748
2749 #define AARCH64_RT(insn) AARCH64_BITS (insn, 0, 5)
2750 #define AARCH64_RT2(insn) AARCH64_BITS (insn, 10, 5)
2751 #define AARCH64_RA(insn) AARCH64_BITS (insn, 10, 5)
2752 #define AARCH64_RD(insn) AARCH64_BITS (insn, 0, 5)
2753 #define AARCH64_RN(insn) AARCH64_BITS (insn, 5, 5)
2754 #define AARCH64_RM(insn) AARCH64_BITS (insn, 16, 5)
2755
2756 #define AARCH64_MAC(insn) (((insn) & 0xff000000) == 0x9b000000)
2757 #define AARCH64_BIT(insn, n) AARCH64_BITS (insn, n, 1)
2758 #define AARCH64_OP31(insn) AARCH64_BITS (insn, 21, 3)
2759 #define AARCH64_ZR 0x1f
2760
2761 /* All ld/st ops. See C4-182 of the ARM ARM. The encoding space for
2762 LD_PCREL, LDST_RO, LDST_UI and LDST_UIMM cover prefetch ops. */
2763
2764 #define AARCH64_LD(insn) (AARCH64_BIT (insn, 22) == 1)
2765 #define AARCH64_LDST(insn) (((insn) & 0x0a000000) == 0x08000000)
2766 #define AARCH64_LDST_EX(insn) (((insn) & 0x3f000000) == 0x08000000)
2767 #define AARCH64_LDST_PCREL(insn) (((insn) & 0x3b000000) == 0x18000000)
2768 #define AARCH64_LDST_NAP(insn) (((insn) & 0x3b800000) == 0x28000000)
2769 #define AARCH64_LDSTP_PI(insn) (((insn) & 0x3b800000) == 0x28800000)
2770 #define AARCH64_LDSTP_O(insn) (((insn) & 0x3b800000) == 0x29000000)
2771 #define AARCH64_LDSTP_PRE(insn) (((insn) & 0x3b800000) == 0x29800000)
2772 #define AARCH64_LDST_UI(insn) (((insn) & 0x3b200c00) == 0x38000000)
2773 #define AARCH64_LDST_PIIMM(insn) (((insn) & 0x3b200c00) == 0x38000400)
2774 #define AARCH64_LDST_U(insn) (((insn) & 0x3b200c00) == 0x38000800)
2775 #define AARCH64_LDST_PREIMM(insn) (((insn) & 0x3b200c00) == 0x38000c00)
2776 #define AARCH64_LDST_RO(insn) (((insn) & 0x3b200c00) == 0x38200800)
2777 #define AARCH64_LDST_UIMM(insn) (((insn) & 0x3b000000) == 0x39000000)
2778 #define AARCH64_LDST_SIMD_M(insn) (((insn) & 0xbfbf0000) == 0x0c000000)
2779 #define AARCH64_LDST_SIMD_M_PI(insn) (((insn) & 0xbfa00000) == 0x0c800000)
2780 #define AARCH64_LDST_SIMD_S(insn) (((insn) & 0xbf9f0000) == 0x0d000000)
2781 #define AARCH64_LDST_SIMD_S_PI(insn) (((insn) & 0xbf800000) == 0x0d800000)
2782
2783 /* Classify an INSN if it is indeed a load/store.
2784
2785 Return TRUE if INSN is a LD/ST instruction otherwise return FALSE.
2786
2787 For scalar LD/ST instructions PAIR is FALSE, RT is returned and RT2
2788 is set equal to RT.
2789
2790 For LD/ST pair instructions PAIR is TRUE, RT and RT2 are returned.
2791
2792 */
2793
2794 static bfd_boolean
2795 aarch64_mem_op_p (uint32_t insn, unsigned int *rt, unsigned int *rt2,
2796 bfd_boolean *pair, bfd_boolean *load)
2797 {
2798 uint32_t opcode;
2799 unsigned int r;
2800 uint32_t opc = 0;
2801 uint32_t v = 0;
2802 uint32_t opc_v = 0;
2803
2804 /* Bail out quickly if INSN doesn't fall into the the load-store
2805 encoding space. */
2806 if (!AARCH64_LDST (insn))
2807 return FALSE;
2808
2809 *pair = FALSE;
2810 *load = FALSE;
2811 if (AARCH64_LDST_EX (insn))
2812 {
2813 *rt = AARCH64_RT (insn);
2814 *rt2 = *rt;
2815 if (AARCH64_BIT (insn, 21) == 1)
2816 {
2817 *pair = TRUE;
2818 *rt2 = AARCH64_RT2 (insn);
2819 }
2820 *load = AARCH64_LD (insn);
2821 return TRUE;
2822 }
2823 else if (AARCH64_LDST_NAP (insn)
2824 || AARCH64_LDSTP_PI (insn)
2825 || AARCH64_LDSTP_O (insn)
2826 || AARCH64_LDSTP_PRE (insn))
2827 {
2828 *pair = TRUE;
2829 *rt = AARCH64_RT (insn);
2830 *rt2 = AARCH64_RT2 (insn);
2831 *load = AARCH64_LD (insn);
2832 return TRUE;
2833 }
2834 else if (AARCH64_LDST_PCREL (insn)
2835 || AARCH64_LDST_UI (insn)
2836 || AARCH64_LDST_PIIMM (insn)
2837 || AARCH64_LDST_U (insn)
2838 || AARCH64_LDST_PREIMM (insn)
2839 || AARCH64_LDST_RO (insn)
2840 || AARCH64_LDST_UIMM (insn))
2841 {
2842 *rt = AARCH64_RT (insn);
2843 *rt2 = *rt;
2844 if (AARCH64_LDST_PCREL (insn))
2845 *load = TRUE;
2846 opc = AARCH64_BITS (insn, 22, 2);
2847 v = AARCH64_BIT (insn, 26);
2848 opc_v = opc | (v << 2);
2849 *load = (opc_v == 1 || opc_v == 2 || opc_v == 3
2850 || opc_v == 5 || opc_v == 7);
2851 return TRUE;
2852 }
2853 else if (AARCH64_LDST_SIMD_M (insn)
2854 || AARCH64_LDST_SIMD_M_PI (insn))
2855 {
2856 *rt = AARCH64_RT (insn);
2857 *load = AARCH64_BIT (insn, 22);
2858 opcode = (insn >> 12) & 0xf;
2859 switch (opcode)
2860 {
2861 case 0:
2862 case 2:
2863 *rt2 = *rt + 3;
2864 break;
2865
2866 case 4:
2867 case 6:
2868 *rt2 = *rt + 2;
2869 break;
2870
2871 case 7:
2872 *rt2 = *rt;
2873 break;
2874
2875 case 8:
2876 case 10:
2877 *rt2 = *rt + 1;
2878 break;
2879
2880 default:
2881 return FALSE;
2882 }
2883 return TRUE;
2884 }
2885 else if (AARCH64_LDST_SIMD_S (insn)
2886 || AARCH64_LDST_SIMD_S_PI (insn))
2887 {
2888 *rt = AARCH64_RT (insn);
2889 r = (insn >> 21) & 1;
2890 *load = AARCH64_BIT (insn, 22);
2891 opcode = (insn >> 13) & 0x7;
2892 switch (opcode)
2893 {
2894 case 0:
2895 case 2:
2896 case 4:
2897 *rt2 = *rt + r;
2898 break;
2899
2900 case 1:
2901 case 3:
2902 case 5:
2903 *rt2 = *rt + (r == 0 ? 2 : 3);
2904 break;
2905
2906 case 6:
2907 *rt2 = *rt + r;
2908 break;
2909
2910 case 7:
2911 *rt2 = *rt + (r == 0 ? 2 : 3);
2912 break;
2913
2914 default:
2915 return FALSE;
2916 }
2917 return TRUE;
2918 }
2919
2920 return FALSE;
2921 }
2922
2923 /* Return TRUE if INSN is multiply-accumulate. */
2924
2925 static bfd_boolean
2926 aarch64_mlxl_p (uint32_t insn)
2927 {
2928 uint32_t op31 = AARCH64_OP31 (insn);
2929
2930 if (AARCH64_MAC (insn)
2931 && (op31 == 0 || op31 == 1 || op31 == 5)
2932 /* Exclude MUL instructions which are encoded as a multiple accumulate
2933 with RA = XZR. */
2934 && AARCH64_RA (insn) != AARCH64_ZR)
2935 return TRUE;
2936
2937 return FALSE;
2938 }
2939
2940 /* Some early revisions of the Cortex-A53 have an erratum (835769) whereby
2941 it is possible for a 64-bit multiply-accumulate instruction to generate an
2942 incorrect result. The details are quite complex and hard to
2943 determine statically, since branches in the code may exist in some
2944 circumstances, but all cases end with a memory (load, store, or
2945 prefetch) instruction followed immediately by the multiply-accumulate
2946 operation. We employ a linker patching technique, by moving the potentially
2947 affected multiply-accumulate instruction into a patch region and replacing
2948 the original instruction with a branch to the patch. This function checks
2949 if INSN_1 is the memory operation followed by a multiply-accumulate
2950 operation (INSN_2). Return TRUE if an erratum sequence is found, FALSE
2951 if INSN_1 and INSN_2 are safe. */
2952
2953 static bfd_boolean
2954 aarch64_erratum_sequence (uint32_t insn_1, uint32_t insn_2)
2955 {
2956 uint32_t rt;
2957 uint32_t rt2;
2958 uint32_t rn;
2959 uint32_t rm;
2960 uint32_t ra;
2961 bfd_boolean pair;
2962 bfd_boolean load;
2963
2964 if (aarch64_mlxl_p (insn_2)
2965 && aarch64_mem_op_p (insn_1, &rt, &rt2, &pair, &load))
2966 {
2967 /* Any SIMD memory op is independent of the subsequent MLA
2968 by definition of the erratum. */
2969 if (AARCH64_BIT (insn_1, 26))
2970 return TRUE;
2971
2972 /* If not SIMD, check for integer memory ops and MLA relationship. */
2973 rn = AARCH64_RN (insn_2);
2974 ra = AARCH64_RA (insn_2);
2975 rm = AARCH64_RM (insn_2);
2976
2977 /* If this is a load and there's a true(RAW) dependency, we are safe
2978 and this is not an erratum sequence. */
2979 if (load &&
2980 (rt == rn || rt == rm || rt == ra
2981 || (pair && (rt2 == rn || rt2 == rm || rt2 == ra))))
2982 return FALSE;
2983
2984 /* We conservatively put out stubs for all other cases (including
2985 writebacks). */
2986 return TRUE;
2987 }
2988
2989 return FALSE;
2990 }
2991
2992 /* Used to order a list of mapping symbols by address. */
2993
2994 static int
2995 elf_aarch64_compare_mapping (const void *a, const void *b)
2996 {
2997 const elf_aarch64_section_map *amap = (const elf_aarch64_section_map *) a;
2998 const elf_aarch64_section_map *bmap = (const elf_aarch64_section_map *) b;
2999
3000 if (amap->vma > bmap->vma)
3001 return 1;
3002 else if (amap->vma < bmap->vma)
3003 return -1;
3004 else if (amap->type > bmap->type)
3005 /* Ensure results do not depend on the host qsort for objects with
3006 multiple mapping symbols at the same address by sorting on type
3007 after vma. */
3008 return 1;
3009 else if (amap->type < bmap->type)
3010 return -1;
3011 else
3012 return 0;
3013 }
3014
3015
3016 static char *
3017 _bfd_aarch64_erratum_835769_stub_name (unsigned num_fixes)
3018 {
3019 char *stub_name = (char *) bfd_malloc
3020 (strlen ("__erratum_835769_veneer_") + 16);
3021 sprintf (stub_name,"__erratum_835769_veneer_%d", num_fixes);
3022 return stub_name;
3023 }
3024
3025 /* Scan for cortex-a53 erratum 835769 sequence.
3026
3027 Return TRUE else FALSE on abnormal termination. */
3028
3029 static bfd_boolean
3030 erratum_835769_scan (bfd *input_bfd,
3031 struct bfd_link_info *info,
3032 struct aarch64_erratum_835769_fix **fixes_p,
3033 unsigned int *num_fixes_p,
3034 unsigned int *fix_table_size_p)
3035 {
3036 asection *section;
3037 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
3038 struct aarch64_erratum_835769_fix *fixes = *fixes_p;
3039 unsigned int num_fixes = *num_fixes_p;
3040 unsigned int fix_table_size = *fix_table_size_p;
3041
3042 if (htab == NULL)
3043 return TRUE;
3044
3045 for (section = input_bfd->sections;
3046 section != NULL;
3047 section = section->next)
3048 {
3049 bfd_byte *contents = NULL;
3050 struct _aarch64_elf_section_data *sec_data;
3051 unsigned int span;
3052
3053 if (elf_section_type (section) != SHT_PROGBITS
3054 || (elf_section_flags (section) & SHF_EXECINSTR) == 0
3055 || (section->flags & SEC_EXCLUDE) != 0
3056 || (section->sec_info_type == SEC_INFO_TYPE_JUST_SYMS)
3057 || (section->output_section == bfd_abs_section_ptr))
3058 continue;
3059
3060 if (elf_section_data (section)->this_hdr.contents != NULL)
3061 contents = elf_section_data (section)->this_hdr.contents;
3062 else if (! bfd_malloc_and_get_section (input_bfd, section, &contents))
3063 return FALSE;
3064
3065 sec_data = elf_aarch64_section_data (section);
3066
3067 qsort (sec_data->map, sec_data->mapcount,
3068 sizeof (elf_aarch64_section_map), elf_aarch64_compare_mapping);
3069
3070 for (span = 0; span < sec_data->mapcount; span++)
3071 {
3072 unsigned int span_start = sec_data->map[span].vma;
3073 unsigned int span_end = ((span == sec_data->mapcount - 1)
3074 ? sec_data->map[0].vma + section->size
3075 : sec_data->map[span + 1].vma);
3076 unsigned int i;
3077 char span_type = sec_data->map[span].type;
3078
3079 if (span_type == 'd')
3080 continue;
3081
3082 for (i = span_start; i + 4 < span_end; i += 4)
3083 {
3084 uint32_t insn_1 = bfd_getl32 (contents + i);
3085 uint32_t insn_2 = bfd_getl32 (contents + i + 4);
3086
3087 if (aarch64_erratum_sequence (insn_1, insn_2))
3088 {
3089 char *stub_name = _bfd_aarch64_erratum_835769_stub_name (num_fixes);
3090 if (! stub_name)
3091 return FALSE;
3092
3093 if (num_fixes == fix_table_size)
3094 {
3095 fix_table_size *= 2;
3096 fixes =
3097 (struct aarch64_erratum_835769_fix *)
3098 bfd_realloc (fixes,
3099 sizeof (struct aarch64_erratum_835769_fix)
3100 * fix_table_size);
3101 if (fixes == NULL)
3102 return FALSE;
3103 }
3104
3105 fixes[num_fixes].input_bfd = input_bfd;
3106 fixes[num_fixes].section = section;
3107 fixes[num_fixes].offset = i + 4;
3108 fixes[num_fixes].veneered_insn = insn_2;
3109 fixes[num_fixes].stub_name = stub_name;
3110 fixes[num_fixes].stub_type = aarch64_stub_erratum_835769_veneer;
3111 num_fixes++;
3112 }
3113 }
3114 }
3115 if (elf_section_data (section)->this_hdr.contents == NULL)
3116 free (contents);
3117 }
3118
3119 *fixes_p = fixes;
3120 *num_fixes_p = num_fixes;
3121 *fix_table_size_p = fix_table_size;
3122 return TRUE;
3123 }
3124
3125
3126 /* Resize all stub sections. */
3127
3128 static void
3129 _bfd_aarch64_resize_stubs (struct elf_aarch64_link_hash_table *htab)
3130 {
3131 asection *section;
3132
3133 /* OK, we've added some stubs. Find out the new size of the
3134 stub sections. */
3135 for (section = htab->stub_bfd->sections;
3136 section != NULL; section = section->next)
3137 {
3138 /* Ignore non-stub sections. */
3139 if (!strstr (section->name, STUB_SUFFIX))
3140 continue;
3141 section->size = 0;
3142 }
3143
3144 bfd_hash_traverse (&htab->stub_hash_table, aarch64_size_one_stub, htab);
3145 }
3146
3147
3148 /* Determine and set the size of the stub section for a final link.
3149
3150 The basic idea here is to examine all the relocations looking for
3151 PC-relative calls to a target that is unreachable with a "bl"
3152 instruction. */
3153
3154 bfd_boolean
3155 elfNN_aarch64_size_stubs (bfd *output_bfd,
3156 bfd *stub_bfd,
3157 struct bfd_link_info *info,
3158 bfd_signed_vma group_size,
3159 asection * (*add_stub_section) (const char *,
3160 asection *),
3161 void (*layout_sections_again) (void))
3162 {
3163 bfd_size_type stub_group_size;
3164 bfd_boolean stubs_always_before_branch;
3165 bfd_boolean stub_changed = 0;
3166 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
3167 struct aarch64_erratum_835769_fix *erratum_835769_fixes = NULL;
3168 unsigned int num_erratum_835769_fixes = 0;
3169 unsigned int erratum_835769_fix_table_size = 10;
3170 unsigned int i;
3171
3172 if (htab->fix_erratum_835769)
3173 {
3174 erratum_835769_fixes
3175 = (struct aarch64_erratum_835769_fix *)
3176 bfd_zmalloc
3177 (sizeof (struct aarch64_erratum_835769_fix) *
3178 erratum_835769_fix_table_size);
3179 if (erratum_835769_fixes == NULL)
3180 goto error_ret_free_local;
3181 }
3182
3183 /* Propagate mach to stub bfd, because it may not have been
3184 finalized when we created stub_bfd. */
3185 bfd_set_arch_mach (stub_bfd, bfd_get_arch (output_bfd),
3186 bfd_get_mach (output_bfd));
3187
3188 /* Stash our params away. */
3189 htab->stub_bfd = stub_bfd;
3190 htab->add_stub_section = add_stub_section;
3191 htab->layout_sections_again = layout_sections_again;
3192 stubs_always_before_branch = group_size < 0;
3193 if (group_size < 0)
3194 stub_group_size = -group_size;
3195 else
3196 stub_group_size = group_size;
3197
3198 if (stub_group_size == 1)
3199 {
3200 /* Default values. */
3201 /* AArch64 branch range is +-128MB. The value used is 1MB less. */
3202 stub_group_size = 127 * 1024 * 1024;
3203 }
3204
3205 group_sections (htab, stub_group_size, stubs_always_before_branch);
3206
3207 while (1)
3208 {
3209 bfd *input_bfd;
3210 asection *stub_sec;
3211 unsigned prev_num_erratum_835769_fixes = num_erratum_835769_fixes;
3212
3213 num_erratum_835769_fixes = 0;
3214 for (input_bfd = info->input_bfds;
3215 input_bfd != NULL; input_bfd = input_bfd->link.next)
3216 {
3217 Elf_Internal_Shdr *symtab_hdr;
3218 asection *section;
3219 Elf_Internal_Sym *local_syms = NULL;
3220
3221 /* We'll need the symbol table in a second. */
3222 symtab_hdr = &elf_tdata (input_bfd)->symtab_hdr;
3223 if (symtab_hdr->sh_info == 0)
3224 continue;
3225
3226 /* Walk over each section attached to the input bfd. */
3227 for (section = input_bfd->sections;
3228 section != NULL; section = section->next)
3229 {
3230 Elf_Internal_Rela *internal_relocs, *irelaend, *irela;
3231
3232 /* If there aren't any relocs, then there's nothing more
3233 to do. */
3234 if ((section->flags & SEC_RELOC) == 0
3235 || section->reloc_count == 0
3236 || (section->flags & SEC_CODE) == 0)
3237 continue;
3238
3239 /* If this section is a link-once section that will be
3240 discarded, then don't create any stubs. */
3241 if (section->output_section == NULL
3242 || section->output_section->owner != output_bfd)
3243 continue;
3244
3245 /* Get the relocs. */
3246 internal_relocs
3247 = _bfd_elf_link_read_relocs (input_bfd, section, NULL,
3248 NULL, info->keep_memory);
3249 if (internal_relocs == NULL)
3250 goto error_ret_free_local;
3251
3252 /* Now examine each relocation. */
3253 irela = internal_relocs;
3254 irelaend = irela + section->reloc_count;
3255 for (; irela < irelaend; irela++)
3256 {
3257 unsigned int r_type, r_indx;
3258 enum elf_aarch64_stub_type stub_type;
3259 struct elf_aarch64_stub_hash_entry *stub_entry;
3260 asection *sym_sec;
3261 bfd_vma sym_value;
3262 bfd_vma destination;
3263 struct elf_aarch64_link_hash_entry *hash;
3264 const char *sym_name;
3265 char *stub_name;
3266 const asection *id_sec;
3267 unsigned char st_type;
3268 bfd_size_type len;
3269
3270 r_type = ELFNN_R_TYPE (irela->r_info);
3271 r_indx = ELFNN_R_SYM (irela->r_info);
3272
3273 if (r_type >= (unsigned int) R_AARCH64_end)
3274 {
3275 bfd_set_error (bfd_error_bad_value);
3276 error_ret_free_internal:
3277 if (elf_section_data (section)->relocs == NULL)
3278 free (internal_relocs);
3279 goto error_ret_free_local;
3280 }
3281
3282 /* Only look for stubs on unconditional branch and
3283 branch and link instructions. */
3284 if (r_type != (unsigned int) AARCH64_R (CALL26)
3285 && r_type != (unsigned int) AARCH64_R (JUMP26))
3286 continue;
3287
3288 /* Now determine the call target, its name, value,
3289 section. */
3290 sym_sec = NULL;
3291 sym_value = 0;
3292 destination = 0;
3293 hash = NULL;
3294 sym_name = NULL;
3295 if (r_indx < symtab_hdr->sh_info)
3296 {
3297 /* It's a local symbol. */
3298 Elf_Internal_Sym *sym;
3299 Elf_Internal_Shdr *hdr;
3300
3301 if (local_syms == NULL)
3302 {
3303 local_syms
3304 = (Elf_Internal_Sym *) symtab_hdr->contents;
3305 if (local_syms == NULL)
3306 local_syms
3307 = bfd_elf_get_elf_syms (input_bfd, symtab_hdr,
3308 symtab_hdr->sh_info, 0,
3309 NULL, NULL, NULL);
3310 if (local_syms == NULL)
3311 goto error_ret_free_internal;
3312 }
3313
3314 sym = local_syms + r_indx;
3315 hdr = elf_elfsections (input_bfd)[sym->st_shndx];
3316 sym_sec = hdr->bfd_section;
3317 if (!sym_sec)
3318 /* This is an undefined symbol. It can never
3319 be resolved. */
3320 continue;
3321
3322 if (ELF_ST_TYPE (sym->st_info) != STT_SECTION)
3323 sym_value = sym->st_value;
3324 destination = (sym_value + irela->r_addend
3325 + sym_sec->output_offset
3326 + sym_sec->output_section->vma);
3327 st_type = ELF_ST_TYPE (sym->st_info);
3328 sym_name
3329 = bfd_elf_string_from_elf_section (input_bfd,
3330 symtab_hdr->sh_link,
3331 sym->st_name);
3332 }
3333 else
3334 {
3335 int e_indx;
3336
3337 e_indx = r_indx - symtab_hdr->sh_info;
3338 hash = ((struct elf_aarch64_link_hash_entry *)
3339 elf_sym_hashes (input_bfd)[e_indx]);
3340
3341 while (hash->root.root.type == bfd_link_hash_indirect
3342 || hash->root.root.type == bfd_link_hash_warning)
3343 hash = ((struct elf_aarch64_link_hash_entry *)
3344 hash->root.root.u.i.link);
3345
3346 if (hash->root.root.type == bfd_link_hash_defined
3347 || hash->root.root.type == bfd_link_hash_defweak)
3348 {
3349 struct elf_aarch64_link_hash_table *globals =
3350 elf_aarch64_hash_table (info);
3351 sym_sec = hash->root.root.u.def.section;
3352 sym_value = hash->root.root.u.def.value;
3353 /* For a destination in a shared library,
3354 use the PLT stub as target address to
3355 decide whether a branch stub is
3356 needed. */
3357 if (globals->root.splt != NULL && hash != NULL
3358 && hash->root.plt.offset != (bfd_vma) - 1)
3359 {
3360 sym_sec = globals->root.splt;
3361 sym_value = hash->root.plt.offset;
3362 if (sym_sec->output_section != NULL)
3363 destination = (sym_value
3364 + sym_sec->output_offset
3365 +
3366 sym_sec->output_section->vma);
3367 }
3368 else if (sym_sec->output_section != NULL)
3369 destination = (sym_value + irela->r_addend
3370 + sym_sec->output_offset
3371 + sym_sec->output_section->vma);
3372 }
3373 else if (hash->root.root.type == bfd_link_hash_undefined
3374 || (hash->root.root.type
3375 == bfd_link_hash_undefweak))
3376 {
3377 /* For a shared library, use the PLT stub as
3378 target address to decide whether a long
3379 branch stub is needed.
3380 For absolute code, they cannot be handled. */
3381 struct elf_aarch64_link_hash_table *globals =
3382 elf_aarch64_hash_table (info);
3383
3384 if (globals->root.splt != NULL && hash != NULL
3385 && hash->root.plt.offset != (bfd_vma) - 1)
3386 {
3387 sym_sec = globals->root.splt;
3388 sym_value = hash->root.plt.offset;
3389 if (sym_sec->output_section != NULL)
3390 destination = (sym_value
3391 + sym_sec->output_offset
3392 +
3393 sym_sec->output_section->vma);
3394 }
3395 else
3396 continue;
3397 }
3398 else
3399 {
3400 bfd_set_error (bfd_error_bad_value);
3401 goto error_ret_free_internal;
3402 }
3403 st_type = ELF_ST_TYPE (hash->root.type);
3404 sym_name = hash->root.root.root.string;
3405 }
3406
3407 /* Determine what (if any) linker stub is needed. */
3408 stub_type = aarch64_type_of_stub
3409 (info, section, irela, st_type, hash, destination);
3410 if (stub_type == aarch64_stub_none)
3411 continue;
3412
3413 /* Support for grouping stub sections. */
3414 id_sec = htab->stub_group[section->id].link_sec;
3415
3416 /* Get the name of this stub. */
3417 stub_name = elfNN_aarch64_stub_name (id_sec, sym_sec, hash,
3418 irela);
3419 if (!stub_name)
3420 goto error_ret_free_internal;
3421
3422 stub_entry =
3423 aarch64_stub_hash_lookup (&htab->stub_hash_table,
3424 stub_name, FALSE, FALSE);
3425 if (stub_entry != NULL)
3426 {
3427 /* The proper stub has already been created. */
3428 free (stub_name);
3429 continue;
3430 }
3431
3432 stub_entry = _bfd_aarch64_add_stub_entry_in_group
3433 (stub_name, section, htab);
3434 if (stub_entry == NULL)
3435 {
3436 free (stub_name);
3437 goto error_ret_free_internal;
3438 }
3439
3440 stub_entry->target_value = sym_value;
3441 stub_entry->target_section = sym_sec;
3442 stub_entry->stub_type = stub_type;
3443 stub_entry->h = hash;
3444 stub_entry->st_type = st_type;
3445
3446 if (sym_name == NULL)
3447 sym_name = "unnamed";
3448 len = sizeof (STUB_ENTRY_NAME) + strlen (sym_name);
3449 stub_entry->output_name = bfd_alloc (htab->stub_bfd, len);
3450 if (stub_entry->output_name == NULL)
3451 {
3452 free (stub_name);
3453 goto error_ret_free_internal;
3454 }
3455
3456 snprintf (stub_entry->output_name, len, STUB_ENTRY_NAME,
3457 sym_name);
3458
3459 stub_changed = TRUE;
3460 }
3461
3462 /* We're done with the internal relocs, free them. */
3463 if (elf_section_data (section)->relocs == NULL)
3464 free (internal_relocs);
3465 }
3466
3467 if (htab->fix_erratum_835769)
3468 {
3469 /* Scan for sequences which might trigger erratum 835769. */
3470 if (!erratum_835769_scan (input_bfd, info, &erratum_835769_fixes,
3471 &num_erratum_835769_fixes,
3472 &erratum_835769_fix_table_size))
3473 goto error_ret_free_local;
3474 }
3475 }
3476
3477 if (prev_num_erratum_835769_fixes != num_erratum_835769_fixes)
3478 stub_changed = TRUE;
3479
3480 if (!stub_changed)
3481 break;
3482
3483 _bfd_aarch64_resize_stubs (htab);
3484
3485 /* Add erratum 835769 veneers to stub section sizes too. */
3486 if (htab->fix_erratum_835769)
3487 for (i = 0; i < num_erratum_835769_fixes; i++)
3488 {
3489 stub_sec = _bfd_aarch64_create_or_find_stub_sec
3490 (erratum_835769_fixes[i].section, htab);
3491
3492 if (stub_sec == NULL)
3493 goto error_ret_free_local;
3494
3495 stub_sec->size += 8;
3496 }
3497
3498 /* Ask the linker to do its stuff. */
3499 (*htab->layout_sections_again) ();
3500 stub_changed = FALSE;
3501 }
3502
3503 /* Add stubs for erratum 835769 fixes now. */
3504 if (htab->fix_erratum_835769)
3505 {
3506 for (i = 0; i < num_erratum_835769_fixes; i++)
3507 {
3508 struct elf_aarch64_stub_hash_entry *stub_entry;
3509 char *stub_name = erratum_835769_fixes[i].stub_name;
3510 asection *section = erratum_835769_fixes[i].section;
3511 unsigned int section_id = erratum_835769_fixes[i].section->id;
3512 asection *link_sec = htab->stub_group[section_id].link_sec;
3513 asection *stub_sec = htab->stub_group[section_id].stub_sec;
3514
3515 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table,
3516 stub_name, TRUE, FALSE);
3517 if (stub_entry == NULL)
3518 {
3519 (*_bfd_error_handler) (_("%s: cannot create stub entry %s"),
3520 section->owner,
3521 stub_name);
3522 return FALSE;
3523 }
3524
3525 stub_entry->stub_sec = stub_sec;
3526 stub_entry->stub_offset = 0;
3527 stub_entry->id_sec = link_sec;
3528 stub_entry->stub_type = erratum_835769_fixes[i].stub_type;
3529 stub_entry->target_section = section;
3530 stub_entry->target_value = erratum_835769_fixes[i].offset;
3531 stub_entry->veneered_insn = erratum_835769_fixes[i].veneered_insn;
3532 stub_entry->output_name = erratum_835769_fixes[i].stub_name;
3533 }
3534 }
3535
3536 return TRUE;
3537
3538 error_ret_free_local:
3539 return FALSE;
3540 }
3541
3542 /* Build all the stubs associated with the current output file. The
3543 stubs are kept in a hash table attached to the main linker hash
3544 table. We also set up the .plt entries for statically linked PIC
3545 functions here. This function is called via aarch64_elf_finish in the
3546 linker. */
3547
3548 bfd_boolean
3549 elfNN_aarch64_build_stubs (struct bfd_link_info *info)
3550 {
3551 asection *stub_sec;
3552 struct bfd_hash_table *table;
3553 struct elf_aarch64_link_hash_table *htab;
3554
3555 htab = elf_aarch64_hash_table (info);
3556
3557 for (stub_sec = htab->stub_bfd->sections;
3558 stub_sec != NULL; stub_sec = stub_sec->next)
3559 {
3560 bfd_size_type size;
3561
3562 /* Ignore non-stub sections. */
3563 if (!strstr (stub_sec->name, STUB_SUFFIX))
3564 continue;
3565
3566 /* Allocate memory to hold the linker stubs. */
3567 size = stub_sec->size;
3568 stub_sec->contents = bfd_zalloc (htab->stub_bfd, size);
3569 if (stub_sec->contents == NULL && size != 0)
3570 return FALSE;
3571 stub_sec->size = 0;
3572 }
3573
3574 /* Build the stubs as directed by the stub hash table. */
3575 table = &htab->stub_hash_table;
3576 bfd_hash_traverse (table, aarch64_build_one_stub, info);
3577
3578 return TRUE;
3579 }
3580
3581
3582 /* Add an entry to the code/data map for section SEC. */
3583
3584 static void
3585 elfNN_aarch64_section_map_add (asection *sec, char type, bfd_vma vma)
3586 {
3587 struct _aarch64_elf_section_data *sec_data =
3588 elf_aarch64_section_data (sec);
3589 unsigned int newidx;
3590
3591 if (sec_data->map == NULL)
3592 {
3593 sec_data->map = bfd_malloc (sizeof (elf_aarch64_section_map));
3594 sec_data->mapcount = 0;
3595 sec_data->mapsize = 1;
3596 }
3597
3598 newidx = sec_data->mapcount++;
3599
3600 if (sec_data->mapcount > sec_data->mapsize)
3601 {
3602 sec_data->mapsize *= 2;
3603 sec_data->map = bfd_realloc_or_free
3604 (sec_data->map, sec_data->mapsize * sizeof (elf_aarch64_section_map));
3605 }
3606
3607 if (sec_data->map)
3608 {
3609 sec_data->map[newidx].vma = vma;
3610 sec_data->map[newidx].type = type;
3611 }
3612 }
3613
3614
3615 /* Initialise maps of insn/data for input BFDs. */
3616 void
3617 bfd_elfNN_aarch64_init_maps (bfd *abfd)
3618 {
3619 Elf_Internal_Sym *isymbuf;
3620 Elf_Internal_Shdr *hdr;
3621 unsigned int i, localsyms;
3622
3623 /* Make sure that we are dealing with an AArch64 elf binary. */
3624 if (!is_aarch64_elf (abfd))
3625 return;
3626
3627 if ((abfd->flags & DYNAMIC) != 0)
3628 return;
3629
3630 hdr = &elf_symtab_hdr (abfd);
3631 localsyms = hdr->sh_info;
3632
3633 /* Obtain a buffer full of symbols for this BFD. The hdr->sh_info field
3634 should contain the number of local symbols, which should come before any
3635 global symbols. Mapping symbols are always local. */
3636 isymbuf = bfd_elf_get_elf_syms (abfd, hdr, localsyms, 0, NULL, NULL, NULL);
3637
3638 /* No internal symbols read? Skip this BFD. */
3639 if (isymbuf == NULL)
3640 return;
3641
3642 for (i = 0; i < localsyms; i++)
3643 {
3644 Elf_Internal_Sym *isym = &isymbuf[i];
3645 asection *sec = bfd_section_from_elf_index (abfd, isym->st_shndx);
3646 const char *name;
3647
3648 if (sec != NULL && ELF_ST_BIND (isym->st_info) == STB_LOCAL)
3649 {
3650 name = bfd_elf_string_from_elf_section (abfd,
3651 hdr->sh_link,
3652 isym->st_name);
3653
3654 if (bfd_is_aarch64_special_symbol_name
3655 (name, BFD_AARCH64_SPECIAL_SYM_TYPE_MAP))
3656 elfNN_aarch64_section_map_add (sec, name[1], isym->st_value);
3657 }
3658 }
3659 }
3660
3661 /* Set option values needed during linking. */
3662 void
3663 bfd_elfNN_aarch64_set_options (struct bfd *output_bfd,
3664 struct bfd_link_info *link_info,
3665 int no_enum_warn,
3666 int no_wchar_warn, int pic_veneer,
3667 int fix_erratum_835769)
3668 {
3669 struct elf_aarch64_link_hash_table *globals;
3670
3671 globals = elf_aarch64_hash_table (link_info);
3672 globals->pic_veneer = pic_veneer;
3673 globals->fix_erratum_835769 = fix_erratum_835769;
3674
3675 BFD_ASSERT (is_aarch64_elf (output_bfd));
3676 elf_aarch64_tdata (output_bfd)->no_enum_size_warning = no_enum_warn;
3677 elf_aarch64_tdata (output_bfd)->no_wchar_size_warning = no_wchar_warn;
3678 }
3679
3680 static bfd_vma
3681 aarch64_calculate_got_entry_vma (struct elf_link_hash_entry *h,
3682 struct elf_aarch64_link_hash_table
3683 *globals, struct bfd_link_info *info,
3684 bfd_vma value, bfd *output_bfd,
3685 bfd_boolean *unresolved_reloc_p)
3686 {
3687 bfd_vma off = (bfd_vma) - 1;
3688 asection *basegot = globals->root.sgot;
3689 bfd_boolean dyn = globals->root.dynamic_sections_created;
3690
3691 if (h != NULL)
3692 {
3693 BFD_ASSERT (basegot != NULL);
3694 off = h->got.offset;
3695 BFD_ASSERT (off != (bfd_vma) - 1);
3696 if (!WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, info->shared, h)
3697 || (info->shared
3698 && SYMBOL_REFERENCES_LOCAL (info, h))
3699 || (ELF_ST_VISIBILITY (h->other)
3700 && h->root.type == bfd_link_hash_undefweak))
3701 {
3702 /* This is actually a static link, or it is a -Bsymbolic link
3703 and the symbol is defined locally. We must initialize this
3704 entry in the global offset table. Since the offset must
3705 always be a multiple of 8 (4 in the case of ILP32), we use
3706 the least significant bit to record whether we have
3707 initialized it already.
3708 When doing a dynamic link, we create a .rel(a).got relocation
3709 entry to initialize the value. This is done in the
3710 finish_dynamic_symbol routine. */
3711 if ((off & 1) != 0)
3712 off &= ~1;
3713 else
3714 {
3715 bfd_put_NN (output_bfd, value, basegot->contents + off);
3716 h->got.offset |= 1;
3717 }
3718 }
3719 else
3720 *unresolved_reloc_p = FALSE;
3721
3722 off = off + basegot->output_section->vma + basegot->output_offset;
3723 }
3724
3725 return off;
3726 }
3727
3728 /* Change R_TYPE to a more efficient access model where possible,
3729 return the new reloc type. */
3730
3731 static bfd_reloc_code_real_type
3732 aarch64_tls_transition_without_check (bfd_reloc_code_real_type r_type,
3733 struct elf_link_hash_entry *h)
3734 {
3735 bfd_boolean is_local = h == NULL;
3736
3737 switch (r_type)
3738 {
3739 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3740 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
3741 return (is_local
3742 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1
3743 : BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21);
3744
3745 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
3746 return (is_local
3747 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC
3748 : r_type);
3749
3750 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
3751 return (is_local
3752 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1
3753 : BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19);
3754
3755 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
3756 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
3757 return (is_local
3758 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC
3759 : BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC);
3760
3761 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
3762 return is_local ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1 : r_type;
3763
3764 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
3765 return is_local ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC : r_type;
3766
3767 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
3768 return r_type;
3769
3770 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
3771 return (is_local
3772 ? BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12
3773 : BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19);
3774
3775 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
3776 case BFD_RELOC_AARCH64_TLSDESC_CALL:
3777 /* Instructions with these relocations will become NOPs. */
3778 return BFD_RELOC_AARCH64_NONE;
3779
3780 default:
3781 break;
3782 }
3783
3784 return r_type;
3785 }
3786
3787 static unsigned int
3788 aarch64_reloc_got_type (bfd_reloc_code_real_type r_type)
3789 {
3790 switch (r_type)
3791 {
3792 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
3793 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
3794 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
3795 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
3796 return GOT_NORMAL;
3797
3798 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3799 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
3800 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
3801 return GOT_TLS_GD;
3802
3803 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
3804 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
3805 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
3806 case BFD_RELOC_AARCH64_TLSDESC_CALL:
3807 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
3808 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
3809 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
3810 return GOT_TLSDESC_GD;
3811
3812 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
3813 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
3814 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
3815 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
3816 return GOT_TLS_IE;
3817
3818 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
3819 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
3820 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
3821 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
3822 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
3823 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
3824 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
3825 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
3826 return GOT_UNKNOWN;
3827
3828 default:
3829 break;
3830 }
3831 return GOT_UNKNOWN;
3832 }
3833
3834 static bfd_boolean
3835 aarch64_can_relax_tls (bfd *input_bfd,
3836 struct bfd_link_info *info,
3837 bfd_reloc_code_real_type r_type,
3838 struct elf_link_hash_entry *h,
3839 unsigned long r_symndx)
3840 {
3841 unsigned int symbol_got_type;
3842 unsigned int reloc_got_type;
3843
3844 if (! IS_AARCH64_TLS_RELOC (r_type))
3845 return FALSE;
3846
3847 symbol_got_type = elfNN_aarch64_symbol_got_type (h, input_bfd, r_symndx);
3848 reloc_got_type = aarch64_reloc_got_type (r_type);
3849
3850 if (symbol_got_type == GOT_TLS_IE && GOT_TLS_GD_ANY_P (reloc_got_type))
3851 return TRUE;
3852
3853 if (info->shared)
3854 return FALSE;
3855
3856 if (h && h->root.type == bfd_link_hash_undefweak)
3857 return FALSE;
3858
3859 return TRUE;
3860 }
3861
3862 /* Given the relocation code R_TYPE, return the relaxed bfd reloc
3863 enumerator. */
3864
3865 static bfd_reloc_code_real_type
3866 aarch64_tls_transition (bfd *input_bfd,
3867 struct bfd_link_info *info,
3868 unsigned int r_type,
3869 struct elf_link_hash_entry *h,
3870 unsigned long r_symndx)
3871 {
3872 bfd_reloc_code_real_type bfd_r_type
3873 = elfNN_aarch64_bfd_reloc_from_type (r_type);
3874
3875 if (! aarch64_can_relax_tls (input_bfd, info, bfd_r_type, h, r_symndx))
3876 return bfd_r_type;
3877
3878 return aarch64_tls_transition_without_check (bfd_r_type, h);
3879 }
3880
3881 /* Return the base VMA address which should be subtracted from real addresses
3882 when resolving R_AARCH64_TLS_DTPREL relocation. */
3883
3884 static bfd_vma
3885 dtpoff_base (struct bfd_link_info *info)
3886 {
3887 /* If tls_sec is NULL, we should have signalled an error already. */
3888 BFD_ASSERT (elf_hash_table (info)->tls_sec != NULL);
3889 return elf_hash_table (info)->tls_sec->vma;
3890 }
3891
3892 /* Return the base VMA address which should be subtracted from real addresses
3893 when resolving R_AARCH64_TLS_GOTTPREL64 relocations. */
3894
3895 static bfd_vma
3896 tpoff_base (struct bfd_link_info *info)
3897 {
3898 struct elf_link_hash_table *htab = elf_hash_table (info);
3899
3900 /* If tls_sec is NULL, we should have signalled an error already. */
3901 BFD_ASSERT (htab->tls_sec != NULL);
3902
3903 bfd_vma base = align_power ((bfd_vma) TCB_SIZE,
3904 htab->tls_sec->alignment_power);
3905 return htab->tls_sec->vma - base;
3906 }
3907
3908 static bfd_vma *
3909 symbol_got_offset_ref (bfd *input_bfd, struct elf_link_hash_entry *h,
3910 unsigned long r_symndx)
3911 {
3912 /* Calculate the address of the GOT entry for symbol
3913 referred to in h. */
3914 if (h != NULL)
3915 return &h->got.offset;
3916 else
3917 {
3918 /* local symbol */
3919 struct elf_aarch64_local_symbol *l;
3920
3921 l = elf_aarch64_locals (input_bfd);
3922 return &l[r_symndx].got_offset;
3923 }
3924 }
3925
3926 static void
3927 symbol_got_offset_mark (bfd *input_bfd, struct elf_link_hash_entry *h,
3928 unsigned long r_symndx)
3929 {
3930 bfd_vma *p;
3931 p = symbol_got_offset_ref (input_bfd, h, r_symndx);
3932 *p |= 1;
3933 }
3934
3935 static int
3936 symbol_got_offset_mark_p (bfd *input_bfd, struct elf_link_hash_entry *h,
3937 unsigned long r_symndx)
3938 {
3939 bfd_vma value;
3940 value = * symbol_got_offset_ref (input_bfd, h, r_symndx);
3941 return value & 1;
3942 }
3943
3944 static bfd_vma
3945 symbol_got_offset (bfd *input_bfd, struct elf_link_hash_entry *h,
3946 unsigned long r_symndx)
3947 {
3948 bfd_vma value;
3949 value = * symbol_got_offset_ref (input_bfd, h, r_symndx);
3950 value &= ~1;
3951 return value;
3952 }
3953
3954 static bfd_vma *
3955 symbol_tlsdesc_got_offset_ref (bfd *input_bfd, struct elf_link_hash_entry *h,
3956 unsigned long r_symndx)
3957 {
3958 /* Calculate the address of the GOT entry for symbol
3959 referred to in h. */
3960 if (h != NULL)
3961 {
3962 struct elf_aarch64_link_hash_entry *eh;
3963 eh = (struct elf_aarch64_link_hash_entry *) h;
3964 return &eh->tlsdesc_got_jump_table_offset;
3965 }
3966 else
3967 {
3968 /* local symbol */
3969 struct elf_aarch64_local_symbol *l;
3970
3971 l = elf_aarch64_locals (input_bfd);
3972 return &l[r_symndx].tlsdesc_got_jump_table_offset;
3973 }
3974 }
3975
3976 static void
3977 symbol_tlsdesc_got_offset_mark (bfd *input_bfd, struct elf_link_hash_entry *h,
3978 unsigned long r_symndx)
3979 {
3980 bfd_vma *p;
3981 p = symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
3982 *p |= 1;
3983 }
3984
3985 static int
3986 symbol_tlsdesc_got_offset_mark_p (bfd *input_bfd,
3987 struct elf_link_hash_entry *h,
3988 unsigned long r_symndx)
3989 {
3990 bfd_vma value;
3991 value = * symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
3992 return value & 1;
3993 }
3994
3995 static bfd_vma
3996 symbol_tlsdesc_got_offset (bfd *input_bfd, struct elf_link_hash_entry *h,
3997 unsigned long r_symndx)
3998 {
3999 bfd_vma value;
4000 value = * symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
4001 value &= ~1;
4002 return value;
4003 }
4004
4005 /* Data for make_branch_to_erratum_835769_stub(). */
4006
4007 struct erratum_835769_branch_to_stub_data
4008 {
4009 asection *output_section;
4010 bfd_byte *contents;
4011 };
4012
4013 /* Helper to insert branches to erratum 835769 stubs in the right
4014 places for a particular section. */
4015
4016 static bfd_boolean
4017 make_branch_to_erratum_835769_stub (struct bfd_hash_entry *gen_entry,
4018 void *in_arg)
4019 {
4020 struct elf_aarch64_stub_hash_entry *stub_entry;
4021 struct erratum_835769_branch_to_stub_data *data;
4022 bfd_byte *contents;
4023 unsigned long branch_insn = 0;
4024 bfd_vma veneered_insn_loc, veneer_entry_loc;
4025 bfd_signed_vma branch_offset;
4026 unsigned int target;
4027 bfd *abfd;
4028
4029 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
4030 data = (struct erratum_835769_branch_to_stub_data *) in_arg;
4031
4032 if (stub_entry->target_section != data->output_section
4033 || stub_entry->stub_type != aarch64_stub_erratum_835769_veneer)
4034 return TRUE;
4035
4036 contents = data->contents;
4037 veneered_insn_loc = stub_entry->target_section->output_section->vma
4038 + stub_entry->target_section->output_offset
4039 + stub_entry->target_value;
4040 veneer_entry_loc = stub_entry->stub_sec->output_section->vma
4041 + stub_entry->stub_sec->output_offset
4042 + stub_entry->stub_offset;
4043 branch_offset = veneer_entry_loc - veneered_insn_loc;
4044
4045 abfd = stub_entry->target_section->owner;
4046 if (!aarch64_valid_branch_p (veneer_entry_loc, veneered_insn_loc))
4047 (*_bfd_error_handler)
4048 (_("%B: error: Erratum 835769 stub out "
4049 "of range (input file too large)"), abfd);
4050
4051 target = stub_entry->target_value;
4052 branch_insn = 0x14000000;
4053 branch_offset >>= 2;
4054 branch_offset &= 0x3ffffff;
4055 branch_insn |= branch_offset;
4056 bfd_putl32 (branch_insn, &contents[target]);
4057
4058 return TRUE;
4059 }
4060
4061 static bfd_boolean
4062 elfNN_aarch64_write_section (bfd *output_bfd ATTRIBUTE_UNUSED,
4063 struct bfd_link_info *link_info,
4064 asection *sec,
4065 bfd_byte *contents)
4066
4067 {
4068 struct elf_aarch64_link_hash_table *globals =
4069 elf_aarch64_hash_table (link_info);
4070
4071 if (globals == NULL)
4072 return FALSE;
4073
4074 /* Fix code to point to erratum 835769 stubs. */
4075 if (globals->fix_erratum_835769)
4076 {
4077 struct erratum_835769_branch_to_stub_data data;
4078
4079 data.output_section = sec;
4080 data.contents = contents;
4081 bfd_hash_traverse (&globals->stub_hash_table,
4082 make_branch_to_erratum_835769_stub, &data);
4083 }
4084
4085 return FALSE;
4086 }
4087
4088 /* Perform a relocation as part of a final link. */
4089 static bfd_reloc_status_type
4090 elfNN_aarch64_final_link_relocate (reloc_howto_type *howto,
4091 bfd *input_bfd,
4092 bfd *output_bfd,
4093 asection *input_section,
4094 bfd_byte *contents,
4095 Elf_Internal_Rela *rel,
4096 bfd_vma value,
4097 struct bfd_link_info *info,
4098 asection *sym_sec,
4099 struct elf_link_hash_entry *h,
4100 bfd_boolean *unresolved_reloc_p,
4101 bfd_boolean save_addend,
4102 bfd_vma *saved_addend,
4103 Elf_Internal_Sym *sym)
4104 {
4105 Elf_Internal_Shdr *symtab_hdr;
4106 unsigned int r_type = howto->type;
4107 bfd_reloc_code_real_type bfd_r_type
4108 = elfNN_aarch64_bfd_reloc_from_howto (howto);
4109 bfd_reloc_code_real_type new_bfd_r_type;
4110 unsigned long r_symndx;
4111 bfd_byte *hit_data = contents + rel->r_offset;
4112 bfd_vma place;
4113 bfd_signed_vma signed_addend;
4114 struct elf_aarch64_link_hash_table *globals;
4115 bfd_boolean weak_undef_p;
4116
4117 globals = elf_aarch64_hash_table (info);
4118
4119 symtab_hdr = &elf_symtab_hdr (input_bfd);
4120
4121 BFD_ASSERT (is_aarch64_elf (input_bfd));
4122
4123 r_symndx = ELFNN_R_SYM (rel->r_info);
4124
4125 /* It is possible to have linker relaxations on some TLS access
4126 models. Update our information here. */
4127 new_bfd_r_type = aarch64_tls_transition (input_bfd, info, r_type, h, r_symndx);
4128 if (new_bfd_r_type != bfd_r_type)
4129 {
4130 bfd_r_type = new_bfd_r_type;
4131 howto = elfNN_aarch64_howto_from_bfd_reloc (bfd_r_type);
4132 BFD_ASSERT (howto != NULL);
4133 r_type = howto->type;
4134 }
4135
4136 place = input_section->output_section->vma
4137 + input_section->output_offset + rel->r_offset;
4138
4139 /* Get addend, accumulating the addend for consecutive relocs
4140 which refer to the same offset. */
4141 signed_addend = saved_addend ? *saved_addend : 0;
4142 signed_addend += rel->r_addend;
4143
4144 weak_undef_p = (h ? h->root.type == bfd_link_hash_undefweak
4145 : bfd_is_und_section (sym_sec));
4146
4147 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle
4148 it here if it is defined in a non-shared object. */
4149 if (h != NULL
4150 && h->type == STT_GNU_IFUNC
4151 && h->def_regular)
4152 {
4153 asection *plt;
4154 const char *name;
4155 asection *base_got;
4156 bfd_vma off;
4157
4158 if ((input_section->flags & SEC_ALLOC) == 0
4159 || h->plt.offset == (bfd_vma) -1)
4160 abort ();
4161
4162 /* STT_GNU_IFUNC symbol must go through PLT. */
4163 plt = globals->root.splt ? globals->root.splt : globals->root.iplt;
4164 value = (plt->output_section->vma + plt->output_offset + h->plt.offset);
4165
4166 switch (bfd_r_type)
4167 {
4168 default:
4169 if (h->root.root.string)
4170 name = h->root.root.string;
4171 else
4172 name = bfd_elf_sym_name (input_bfd, symtab_hdr, sym,
4173 NULL);
4174 (*_bfd_error_handler)
4175 (_("%B: relocation %s against STT_GNU_IFUNC "
4176 "symbol `%s' isn't handled by %s"), input_bfd,
4177 howto->name, name, __FUNCTION__);
4178 bfd_set_error (bfd_error_bad_value);
4179 return FALSE;
4180
4181 case BFD_RELOC_AARCH64_NN:
4182 if (rel->r_addend != 0)
4183 {
4184 if (h->root.root.string)
4185 name = h->root.root.string;
4186 else
4187 name = bfd_elf_sym_name (input_bfd, symtab_hdr,
4188 sym, NULL);
4189 (*_bfd_error_handler)
4190 (_("%B: relocation %s against STT_GNU_IFUNC "
4191 "symbol `%s' has non-zero addend: %d"),
4192 input_bfd, howto->name, name, rel->r_addend);
4193 bfd_set_error (bfd_error_bad_value);
4194 return FALSE;
4195 }
4196
4197 /* Generate dynamic relocation only when there is a
4198 non-GOT reference in a shared object. */
4199 if (info->shared && h->non_got_ref)
4200 {
4201 Elf_Internal_Rela outrel;
4202 asection *sreloc;
4203
4204 /* Need a dynamic relocation to get the real function
4205 address. */
4206 outrel.r_offset = _bfd_elf_section_offset (output_bfd,
4207 info,
4208 input_section,
4209 rel->r_offset);
4210 if (outrel.r_offset == (bfd_vma) -1
4211 || outrel.r_offset == (bfd_vma) -2)
4212 abort ();
4213
4214 outrel.r_offset += (input_section->output_section->vma
4215 + input_section->output_offset);
4216
4217 if (h->dynindx == -1
4218 || h->forced_local
4219 || info->executable)
4220 {
4221 /* This symbol is resolved locally. */
4222 outrel.r_info = ELFNN_R_INFO (0, AARCH64_R (IRELATIVE));
4223 outrel.r_addend = (h->root.u.def.value
4224 + h->root.u.def.section->output_section->vma
4225 + h->root.u.def.section->output_offset);
4226 }
4227 else
4228 {
4229 outrel.r_info = ELFNN_R_INFO (h->dynindx, r_type);
4230 outrel.r_addend = 0;
4231 }
4232
4233 sreloc = globals->root.irelifunc;
4234 elf_append_rela (output_bfd, sreloc, &outrel);
4235
4236 /* If this reloc is against an external symbol, we
4237 do not want to fiddle with the addend. Otherwise,
4238 we need to include the symbol value so that it
4239 becomes an addend for the dynamic reloc. For an
4240 internal symbol, we have updated addend. */
4241 return bfd_reloc_ok;
4242 }
4243 /* FALLTHROUGH */
4244 case BFD_RELOC_AARCH64_JUMP26:
4245 case BFD_RELOC_AARCH64_CALL26:
4246 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4247 signed_addend,
4248 weak_undef_p);
4249 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type,
4250 howto, value);
4251 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
4252 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
4253 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
4254 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
4255 base_got = globals->root.sgot;
4256 off = h->got.offset;
4257
4258 if (base_got == NULL)
4259 abort ();
4260
4261 if (off == (bfd_vma) -1)
4262 {
4263 bfd_vma plt_index;
4264
4265 /* We can't use h->got.offset here to save state, or
4266 even just remember the offset, as finish_dynamic_symbol
4267 would use that as offset into .got. */
4268
4269 if (globals->root.splt != NULL)
4270 {
4271 plt_index = ((h->plt.offset - globals->plt_header_size) /
4272 globals->plt_entry_size);
4273 off = (plt_index + 3) * GOT_ENTRY_SIZE;
4274 base_got = globals->root.sgotplt;
4275 }
4276 else
4277 {
4278 plt_index = h->plt.offset / globals->plt_entry_size;
4279 off = plt_index * GOT_ENTRY_SIZE;
4280 base_got = globals->root.igotplt;
4281 }
4282
4283 if (h->dynindx == -1
4284 || h->forced_local
4285 || info->symbolic)
4286 {
4287 /* This references the local definition. We must
4288 initialize this entry in the global offset table.
4289 Since the offset must always be a multiple of 8,
4290 we use the least significant bit to record
4291 whether we have initialized it already.
4292
4293 When doing a dynamic link, we create a .rela.got
4294 relocation entry to initialize the value. This
4295 is done in the finish_dynamic_symbol routine. */
4296 if ((off & 1) != 0)
4297 off &= ~1;
4298 else
4299 {
4300 bfd_put_NN (output_bfd, value,
4301 base_got->contents + off);
4302 /* Note that this is harmless as -1 | 1 still is -1. */
4303 h->got.offset |= 1;
4304 }
4305 }
4306 value = (base_got->output_section->vma
4307 + base_got->output_offset + off);
4308 }
4309 else
4310 value = aarch64_calculate_got_entry_vma (h, globals, info,
4311 value, output_bfd,
4312 unresolved_reloc_p);
4313 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4314 0, weak_undef_p);
4315 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type, howto, value);
4316 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
4317 case BFD_RELOC_AARCH64_ADD_LO12:
4318 break;
4319 }
4320 }
4321
4322 switch (bfd_r_type)
4323 {
4324 case BFD_RELOC_AARCH64_NONE:
4325 case BFD_RELOC_AARCH64_TLSDESC_CALL:
4326 *unresolved_reloc_p = FALSE;
4327 return bfd_reloc_ok;
4328
4329 case BFD_RELOC_AARCH64_NN:
4330
4331 /* When generating a shared object or relocatable executable, these
4332 relocations are copied into the output file to be resolved at
4333 run time. */
4334 if (((info->shared == TRUE) || globals->root.is_relocatable_executable)
4335 && (input_section->flags & SEC_ALLOC)
4336 && (h == NULL
4337 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
4338 || h->root.type != bfd_link_hash_undefweak))
4339 {
4340 Elf_Internal_Rela outrel;
4341 bfd_byte *loc;
4342 bfd_boolean skip, relocate;
4343 asection *sreloc;
4344
4345 *unresolved_reloc_p = FALSE;
4346
4347 skip = FALSE;
4348 relocate = FALSE;
4349
4350 outrel.r_addend = signed_addend;
4351 outrel.r_offset =
4352 _bfd_elf_section_offset (output_bfd, info, input_section,
4353 rel->r_offset);
4354 if (outrel.r_offset == (bfd_vma) - 1)
4355 skip = TRUE;
4356 else if (outrel.r_offset == (bfd_vma) - 2)
4357 {
4358 skip = TRUE;
4359 relocate = TRUE;
4360 }
4361
4362 outrel.r_offset += (input_section->output_section->vma
4363 + input_section->output_offset);
4364
4365 if (skip)
4366 memset (&outrel, 0, sizeof outrel);
4367 else if (h != NULL
4368 && h->dynindx != -1
4369 && (!info->shared || !SYMBOLIC_BIND (info, h) || !h->def_regular))
4370 outrel.r_info = ELFNN_R_INFO (h->dynindx, r_type);
4371 else
4372 {
4373 int symbol;
4374
4375 /* On SVR4-ish systems, the dynamic loader cannot
4376 relocate the text and data segments independently,
4377 so the symbol does not matter. */
4378 symbol = 0;
4379 outrel.r_info = ELFNN_R_INFO (symbol, AARCH64_R (RELATIVE));
4380 outrel.r_addend += value;
4381 }
4382
4383 sreloc = elf_section_data (input_section)->sreloc;
4384 if (sreloc == NULL || sreloc->contents == NULL)
4385 return bfd_reloc_notsupported;
4386
4387 loc = sreloc->contents + sreloc->reloc_count++ * RELOC_SIZE (globals);
4388 bfd_elfNN_swap_reloca_out (output_bfd, &outrel, loc);
4389
4390 if (sreloc->reloc_count * RELOC_SIZE (globals) > sreloc->size)
4391 {
4392 /* Sanity to check that we have previously allocated
4393 sufficient space in the relocation section for the
4394 number of relocations we actually want to emit. */
4395 abort ();
4396 }
4397
4398 /* If this reloc is against an external symbol, we do not want to
4399 fiddle with the addend. Otherwise, we need to include the symbol
4400 value so that it becomes an addend for the dynamic reloc. */
4401 if (!relocate)
4402 return bfd_reloc_ok;
4403
4404 return _bfd_final_link_relocate (howto, input_bfd, input_section,
4405 contents, rel->r_offset, value,
4406 signed_addend);
4407 }
4408 else
4409 value += signed_addend;
4410 break;
4411
4412 case BFD_RELOC_AARCH64_JUMP26:
4413 case BFD_RELOC_AARCH64_CALL26:
4414 {
4415 asection *splt = globals->root.splt;
4416 bfd_boolean via_plt_p =
4417 splt != NULL && h != NULL && h->plt.offset != (bfd_vma) - 1;
4418
4419 /* A call to an undefined weak symbol is converted to a jump to
4420 the next instruction unless a PLT entry will be created.
4421 The jump to the next instruction is optimized as a NOP.
4422 Do the same for local undefined symbols. */
4423 if (weak_undef_p && ! via_plt_p)
4424 {
4425 bfd_putl32 (INSN_NOP, hit_data);
4426 return bfd_reloc_ok;
4427 }
4428
4429 /* If the call goes through a PLT entry, make sure to
4430 check distance to the right destination address. */
4431 if (via_plt_p)
4432 {
4433 value = (splt->output_section->vma
4434 + splt->output_offset + h->plt.offset);
4435 *unresolved_reloc_p = FALSE;
4436 }
4437
4438 /* If the target symbol is global and marked as a function the
4439 relocation applies a function call or a tail call. In this
4440 situation we can veneer out of range branches. The veneers
4441 use IP0 and IP1 hence cannot be used arbitrary out of range
4442 branches that occur within the body of a function. */
4443 if (h && h->type == STT_FUNC)
4444 {
4445 /* Check if a stub has to be inserted because the destination
4446 is too far away. */
4447 if (! aarch64_valid_branch_p (value, place))
4448 {
4449 /* The target is out of reach, so redirect the branch to
4450 the local stub for this function. */
4451 struct elf_aarch64_stub_hash_entry *stub_entry;
4452 stub_entry = elfNN_aarch64_get_stub_entry (input_section,
4453 sym_sec, h,
4454 rel, globals);
4455 if (stub_entry != NULL)
4456 value = (stub_entry->stub_offset
4457 + stub_entry->stub_sec->output_offset
4458 + stub_entry->stub_sec->output_section->vma);
4459 }
4460 }
4461 }
4462 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4463 signed_addend, weak_undef_p);
4464 break;
4465
4466 case BFD_RELOC_AARCH64_16:
4467 #if ARCH_SIZE == 64
4468 case BFD_RELOC_AARCH64_32:
4469 #endif
4470 case BFD_RELOC_AARCH64_ADD_LO12:
4471 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
4472 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
4473 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
4474 case BFD_RELOC_AARCH64_BRANCH19:
4475 case BFD_RELOC_AARCH64_LD_LO19_PCREL:
4476 case BFD_RELOC_AARCH64_LDST8_LO12:
4477 case BFD_RELOC_AARCH64_LDST16_LO12:
4478 case BFD_RELOC_AARCH64_LDST32_LO12:
4479 case BFD_RELOC_AARCH64_LDST64_LO12:
4480 case BFD_RELOC_AARCH64_LDST128_LO12:
4481 case BFD_RELOC_AARCH64_MOVW_G0_S:
4482 case BFD_RELOC_AARCH64_MOVW_G1_S:
4483 case BFD_RELOC_AARCH64_MOVW_G2_S:
4484 case BFD_RELOC_AARCH64_MOVW_G0:
4485 case BFD_RELOC_AARCH64_MOVW_G0_NC:
4486 case BFD_RELOC_AARCH64_MOVW_G1:
4487 case BFD_RELOC_AARCH64_MOVW_G1_NC:
4488 case BFD_RELOC_AARCH64_MOVW_G2:
4489 case BFD_RELOC_AARCH64_MOVW_G2_NC:
4490 case BFD_RELOC_AARCH64_MOVW_G3:
4491 case BFD_RELOC_AARCH64_16_PCREL:
4492 case BFD_RELOC_AARCH64_32_PCREL:
4493 case BFD_RELOC_AARCH64_64_PCREL:
4494 case BFD_RELOC_AARCH64_TSTBR14:
4495 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4496 signed_addend, weak_undef_p);
4497 break;
4498
4499 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
4500 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
4501 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
4502 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
4503 if (globals->root.sgot == NULL)
4504 BFD_ASSERT (h != NULL);
4505
4506 if (h != NULL)
4507 {
4508 value = aarch64_calculate_got_entry_vma (h, globals, info, value,
4509 output_bfd,
4510 unresolved_reloc_p);
4511 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4512 0, weak_undef_p);
4513 }
4514 break;
4515
4516 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
4517 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
4518 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
4519 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
4520 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
4521 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
4522 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
4523 if (globals->root.sgot == NULL)
4524 return bfd_reloc_notsupported;
4525
4526 value = (symbol_got_offset (input_bfd, h, r_symndx)
4527 + globals->root.sgot->output_section->vma
4528 + globals->root.sgot->output_offset);
4529
4530 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4531 0, weak_undef_p);
4532 *unresolved_reloc_p = FALSE;
4533 break;
4534
4535 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
4536 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
4537 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
4538 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
4539 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
4540 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
4541 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
4542 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
4543 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4544 signed_addend - tpoff_base (info),
4545 weak_undef_p);
4546 *unresolved_reloc_p = FALSE;
4547 break;
4548
4549 case BFD_RELOC_AARCH64_TLSDESC_ADD:
4550 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
4551 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
4552 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
4553 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
4554 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
4555 case BFD_RELOC_AARCH64_TLSDESC_LDR:
4556 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
4557 if (globals->root.sgot == NULL)
4558 return bfd_reloc_notsupported;
4559 value = (symbol_tlsdesc_got_offset (input_bfd, h, r_symndx)
4560 + globals->root.sgotplt->output_section->vma
4561 + globals->root.sgotplt->output_offset
4562 + globals->sgotplt_jump_table_size);
4563
4564 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
4565 0, weak_undef_p);
4566 *unresolved_reloc_p = FALSE;
4567 break;
4568
4569 default:
4570 return bfd_reloc_notsupported;
4571 }
4572
4573 if (saved_addend)
4574 *saved_addend = value;
4575
4576 /* Only apply the final relocation in a sequence. */
4577 if (save_addend)
4578 return bfd_reloc_continue;
4579
4580 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type,
4581 howto, value);
4582 }
4583
4584 /* Handle TLS relaxations. Relaxing is possible for symbols that use
4585 R_AARCH64_TLSDESC_ADR_{PAGE, LD64_LO12_NC, ADD_LO12_NC} during a static
4586 link.
4587
4588 Return bfd_reloc_ok if we're done, bfd_reloc_continue if the caller
4589 is to then call final_link_relocate. Return other values in the
4590 case of error. */
4591
4592 static bfd_reloc_status_type
4593 elfNN_aarch64_tls_relax (struct elf_aarch64_link_hash_table *globals,
4594 bfd *input_bfd, bfd_byte *contents,
4595 Elf_Internal_Rela *rel, struct elf_link_hash_entry *h)
4596 {
4597 bfd_boolean is_local = h == NULL;
4598 unsigned int r_type = ELFNN_R_TYPE (rel->r_info);
4599 unsigned long insn;
4600
4601 BFD_ASSERT (globals && input_bfd && contents && rel);
4602
4603 switch (elfNN_aarch64_bfd_reloc_from_type (r_type))
4604 {
4605 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
4606 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
4607 if (is_local)
4608 {
4609 /* GD->LE relaxation:
4610 adrp x0, :tlsgd:var => movz x0, :tprel_g1:var
4611 or
4612 adrp x0, :tlsdesc:var => movz x0, :tprel_g1:var
4613 */
4614 bfd_putl32 (0xd2a00000, contents + rel->r_offset);
4615 return bfd_reloc_continue;
4616 }
4617 else
4618 {
4619 /* GD->IE relaxation:
4620 adrp x0, :tlsgd:var => adrp x0, :gottprel:var
4621 or
4622 adrp x0, :tlsdesc:var => adrp x0, :gottprel:var
4623 */
4624 return bfd_reloc_continue;
4625 }
4626
4627 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
4628 BFD_ASSERT (0);
4629 break;
4630
4631 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
4632 if (is_local)
4633 {
4634 /* Tiny TLSDESC->LE relaxation:
4635 ldr x1, :tlsdesc:var => movz x0, #:tprel_g1:var
4636 adr x0, :tlsdesc:var => movk x0, #:tprel_g0_nc:var
4637 .tlsdesccall var
4638 blr x1 => nop
4639 */
4640 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (TLSDESC_ADR_PREL21));
4641 BFD_ASSERT (ELFNN_R_TYPE (rel[2].r_info) == AARCH64_R (TLSDESC_CALL));
4642
4643 rel[1].r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
4644 AARCH64_R (TLSLE_MOVW_TPREL_G0_NC));
4645 rel[2].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
4646
4647 bfd_putl32 (0xd2a00000, contents + rel->r_offset);
4648 bfd_putl32 (0xf2800000, contents + rel->r_offset + 4);
4649 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 8);
4650 return bfd_reloc_continue;
4651 }
4652 else
4653 {
4654 /* Tiny TLSDESC->IE relaxation:
4655 ldr x1, :tlsdesc:var => ldr x0, :gottprel:var
4656 adr x0, :tlsdesc:var => nop
4657 .tlsdesccall var
4658 blr x1 => nop
4659 */
4660 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (TLSDESC_ADR_PREL21));
4661 BFD_ASSERT (ELFNN_R_TYPE (rel[2].r_info) == AARCH64_R (TLSDESC_CALL));
4662
4663 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
4664 rel[2].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
4665
4666 bfd_putl32 (0x58000000, contents + rel->r_offset);
4667 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 4);
4668 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 8);
4669 return bfd_reloc_continue;
4670 }
4671
4672 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
4673 if (is_local)
4674 {
4675 /* Tiny GD->LE relaxation:
4676 adr x0, :tlsgd:var => mrs x1, tpidr_el0
4677 bl __tls_get_addr => add x0, x1, #:tprel_hi12:x, lsl #12
4678 nop => add x0, x0, #:tprel_lo12_nc:x
4679 */
4680
4681 /* First kill the tls_get_addr reloc on the bl instruction. */
4682 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
4683
4684 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 0);
4685 bfd_putl32 (0x91400020, contents + rel->r_offset + 4);
4686 bfd_putl32 (0x91000000, contents + rel->r_offset + 8);
4687
4688 rel[1].r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
4689 AARCH64_R (TLSLE_ADD_TPREL_LO12_NC));
4690 rel[1].r_offset = rel->r_offset + 8;
4691
4692 /* Move the current relocation to the second instruction in
4693 the sequence. */
4694 rel->r_offset += 4;
4695 rel->r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
4696 AARCH64_R (TLSLE_ADD_TPREL_HI12));
4697 return bfd_reloc_continue;
4698 }
4699 else
4700 {
4701 /* Tiny GD->IE relaxation:
4702 adr x0, :tlsgd:var => ldr x0, :gottprel:var
4703 bl __tls_get_addr => mrs x1, tpidr_el0
4704 nop => add x0, x0, x1
4705 */
4706
4707 /* First kill the tls_get_addr reloc on the bl instruction. */
4708 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
4709 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
4710
4711 bfd_putl32 (0x58000000, contents + rel->r_offset);
4712 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 4);
4713 bfd_putl32 (0x8b000020, contents + rel->r_offset + 8);
4714 return bfd_reloc_continue;
4715 }
4716
4717 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
4718 return bfd_reloc_continue;
4719
4720 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
4721 if (is_local)
4722 {
4723 /* GD->LE relaxation:
4724 ldr xd, [x0, #:tlsdesc_lo12:var] => movk x0, :tprel_g0_nc:var
4725 */
4726 bfd_putl32 (0xf2800000, contents + rel->r_offset);
4727 return bfd_reloc_continue;
4728 }
4729 else
4730 {
4731 /* GD->IE relaxation:
4732 ldr xd, [x0, #:tlsdesc_lo12:var] => ldr x0, [x0, #:gottprel_lo12:var]
4733 */
4734 insn = bfd_getl32 (contents + rel->r_offset);
4735 insn &= 0xffffffe0;
4736 bfd_putl32 (insn, contents + rel->r_offset);
4737 return bfd_reloc_continue;
4738 }
4739
4740 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
4741 if (is_local)
4742 {
4743 /* GD->LE relaxation
4744 add x0, #:tlsgd_lo12:var => movk x0, :tprel_g0_nc:var
4745 bl __tls_get_addr => mrs x1, tpidr_el0
4746 nop => add x0, x1, x0
4747 */
4748
4749 /* First kill the tls_get_addr reloc on the bl instruction. */
4750 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
4751 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
4752
4753 bfd_putl32 (0xf2800000, contents + rel->r_offset);
4754 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 4);
4755 bfd_putl32 (0x8b000020, contents + rel->r_offset + 8);
4756 return bfd_reloc_continue;
4757 }
4758 else
4759 {
4760 /* GD->IE relaxation
4761 ADD x0, #:tlsgd_lo12:var => ldr x0, [x0, #:gottprel_lo12:var]
4762 BL __tls_get_addr => mrs x1, tpidr_el0
4763 R_AARCH64_CALL26
4764 NOP => add x0, x1, x0
4765 */
4766
4767 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (CALL26));
4768
4769 /* Remove the relocation on the BL instruction. */
4770 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
4771
4772 bfd_putl32 (0xf9400000, contents + rel->r_offset);
4773
4774 /* We choose to fixup the BL and NOP instructions using the
4775 offset from the second relocation to allow flexibility in
4776 scheduling instructions between the ADD and BL. */
4777 bfd_putl32 (0xd53bd041, contents + rel[1].r_offset);
4778 bfd_putl32 (0x8b000020, contents + rel[1].r_offset + 4);
4779 return bfd_reloc_continue;
4780 }
4781
4782 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
4783 case BFD_RELOC_AARCH64_TLSDESC_CALL:
4784 /* GD->IE/LE relaxation:
4785 add x0, x0, #:tlsdesc_lo12:var => nop
4786 blr xd => nop
4787 */
4788 bfd_putl32 (INSN_NOP, contents + rel->r_offset);
4789 return bfd_reloc_ok;
4790
4791 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
4792 /* IE->LE relaxation:
4793 adrp xd, :gottprel:var => movz xd, :tprel_g1:var
4794 */
4795 if (is_local)
4796 {
4797 insn = bfd_getl32 (contents + rel->r_offset);
4798 bfd_putl32 (0xd2a00000 | (insn & 0x1f), contents + rel->r_offset);
4799 }
4800 return bfd_reloc_continue;
4801
4802 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
4803 /* IE->LE relaxation:
4804 ldr xd, [xm, #:gottprel_lo12:var] => movk xd, :tprel_g0_nc:var
4805 */
4806 if (is_local)
4807 {
4808 insn = bfd_getl32 (contents + rel->r_offset);
4809 bfd_putl32 (0xf2800000 | (insn & 0x1f), contents + rel->r_offset);
4810 }
4811 return bfd_reloc_continue;
4812
4813 default:
4814 return bfd_reloc_continue;
4815 }
4816
4817 return bfd_reloc_ok;
4818 }
4819
4820 /* Relocate an AArch64 ELF section. */
4821
4822 static bfd_boolean
4823 elfNN_aarch64_relocate_section (bfd *output_bfd,
4824 struct bfd_link_info *info,
4825 bfd *input_bfd,
4826 asection *input_section,
4827 bfd_byte *contents,
4828 Elf_Internal_Rela *relocs,
4829 Elf_Internal_Sym *local_syms,
4830 asection **local_sections)
4831 {
4832 Elf_Internal_Shdr *symtab_hdr;
4833 struct elf_link_hash_entry **sym_hashes;
4834 Elf_Internal_Rela *rel;
4835 Elf_Internal_Rela *relend;
4836 const char *name;
4837 struct elf_aarch64_link_hash_table *globals;
4838 bfd_boolean save_addend = FALSE;
4839 bfd_vma addend = 0;
4840
4841 globals = elf_aarch64_hash_table (info);
4842
4843 symtab_hdr = &elf_symtab_hdr (input_bfd);
4844 sym_hashes = elf_sym_hashes (input_bfd);
4845
4846 rel = relocs;
4847 relend = relocs + input_section->reloc_count;
4848 for (; rel < relend; rel++)
4849 {
4850 unsigned int r_type;
4851 bfd_reloc_code_real_type bfd_r_type;
4852 bfd_reloc_code_real_type relaxed_bfd_r_type;
4853 reloc_howto_type *howto;
4854 unsigned long r_symndx;
4855 Elf_Internal_Sym *sym;
4856 asection *sec;
4857 struct elf_link_hash_entry *h;
4858 bfd_vma relocation;
4859 bfd_reloc_status_type r;
4860 arelent bfd_reloc;
4861 char sym_type;
4862 bfd_boolean unresolved_reloc = FALSE;
4863 char *error_message = NULL;
4864
4865 r_symndx = ELFNN_R_SYM (rel->r_info);
4866 r_type = ELFNN_R_TYPE (rel->r_info);
4867
4868 bfd_reloc.howto = elfNN_aarch64_howto_from_type (r_type);
4869 howto = bfd_reloc.howto;
4870
4871 if (howto == NULL)
4872 {
4873 (*_bfd_error_handler)
4874 (_("%B: unrecognized relocation (0x%x) in section `%A'"),
4875 input_bfd, input_section, r_type);
4876 return FALSE;
4877 }
4878 bfd_r_type = elfNN_aarch64_bfd_reloc_from_howto (howto);
4879
4880 h = NULL;
4881 sym = NULL;
4882 sec = NULL;
4883
4884 if (r_symndx < symtab_hdr->sh_info)
4885 {
4886 sym = local_syms + r_symndx;
4887 sym_type = ELFNN_ST_TYPE (sym->st_info);
4888 sec = local_sections[r_symndx];
4889
4890 /* An object file might have a reference to a local
4891 undefined symbol. This is a daft object file, but we
4892 should at least do something about it. */
4893 if (r_type != R_AARCH64_NONE && r_type != R_AARCH64_NULL
4894 && bfd_is_und_section (sec)
4895 && ELF_ST_BIND (sym->st_info) != STB_WEAK)
4896 {
4897 if (!info->callbacks->undefined_symbol
4898 (info, bfd_elf_string_from_elf_section
4899 (input_bfd, symtab_hdr->sh_link, sym->st_name),
4900 input_bfd, input_section, rel->r_offset, TRUE))
4901 return FALSE;
4902 }
4903
4904 relocation = _bfd_elf_rela_local_sym (output_bfd, sym, &sec, rel);
4905
4906 /* Relocate against local STT_GNU_IFUNC symbol. */
4907 if (!info->relocatable
4908 && ELF_ST_TYPE (sym->st_info) == STT_GNU_IFUNC)
4909 {
4910 h = elfNN_aarch64_get_local_sym_hash (globals, input_bfd,
4911 rel, FALSE);
4912 if (h == NULL)
4913 abort ();
4914
4915 /* Set STT_GNU_IFUNC symbol value. */
4916 h->root.u.def.value = sym->st_value;
4917 h->root.u.def.section = sec;
4918 }
4919 }
4920 else
4921 {
4922 bfd_boolean warned, ignored;
4923
4924 RELOC_FOR_GLOBAL_SYMBOL (info, input_bfd, input_section, rel,
4925 r_symndx, symtab_hdr, sym_hashes,
4926 h, sec, relocation,
4927 unresolved_reloc, warned, ignored);
4928
4929 sym_type = h->type;
4930 }
4931
4932 if (sec != NULL && discarded_section (sec))
4933 RELOC_AGAINST_DISCARDED_SECTION (info, input_bfd, input_section,
4934 rel, 1, relend, howto, 0, contents);
4935
4936 if (info->relocatable)
4937 continue;
4938
4939 if (h != NULL)
4940 name = h->root.root.string;
4941 else
4942 {
4943 name = (bfd_elf_string_from_elf_section
4944 (input_bfd, symtab_hdr->sh_link, sym->st_name));
4945 if (name == NULL || *name == '\0')
4946 name = bfd_section_name (input_bfd, sec);
4947 }
4948
4949 if (r_symndx != 0
4950 && r_type != R_AARCH64_NONE
4951 && r_type != R_AARCH64_NULL
4952 && (h == NULL
4953 || h->root.type == bfd_link_hash_defined
4954 || h->root.type == bfd_link_hash_defweak)
4955 && IS_AARCH64_TLS_RELOC (bfd_r_type) != (sym_type == STT_TLS))
4956 {
4957 (*_bfd_error_handler)
4958 ((sym_type == STT_TLS
4959 ? _("%B(%A+0x%lx): %s used with TLS symbol %s")
4960 : _("%B(%A+0x%lx): %s used with non-TLS symbol %s")),
4961 input_bfd,
4962 input_section, (long) rel->r_offset, howto->name, name);
4963 }
4964
4965 /* We relax only if we can see that there can be a valid transition
4966 from a reloc type to another.
4967 We call elfNN_aarch64_final_link_relocate unless we're completely
4968 done, i.e., the relaxation produced the final output we want. */
4969
4970 relaxed_bfd_r_type = aarch64_tls_transition (input_bfd, info, r_type,
4971 h, r_symndx);
4972 if (relaxed_bfd_r_type != bfd_r_type)
4973 {
4974 bfd_r_type = relaxed_bfd_r_type;
4975 howto = elfNN_aarch64_howto_from_bfd_reloc (bfd_r_type);
4976 BFD_ASSERT (howto != NULL);
4977 r_type = howto->type;
4978 r = elfNN_aarch64_tls_relax (globals, input_bfd, contents, rel, h);
4979 unresolved_reloc = 0;
4980 }
4981 else
4982 r = bfd_reloc_continue;
4983
4984 /* There may be multiple consecutive relocations for the
4985 same offset. In that case we are supposed to treat the
4986 output of each relocation as the addend for the next. */
4987 if (rel + 1 < relend
4988 && rel->r_offset == rel[1].r_offset
4989 && ELFNN_R_TYPE (rel[1].r_info) != R_AARCH64_NONE
4990 && ELFNN_R_TYPE (rel[1].r_info) != R_AARCH64_NULL)
4991 save_addend = TRUE;
4992 else
4993 save_addend = FALSE;
4994
4995 if (r == bfd_reloc_continue)
4996 r = elfNN_aarch64_final_link_relocate (howto, input_bfd, output_bfd,
4997 input_section, contents, rel,
4998 relocation, info, sec,
4999 h, &unresolved_reloc,
5000 save_addend, &addend, sym);
5001
5002 switch (elfNN_aarch64_bfd_reloc_from_type (r_type))
5003 {
5004 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
5005 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
5006 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
5007 if (! symbol_got_offset_mark_p (input_bfd, h, r_symndx))
5008 {
5009 bfd_boolean need_relocs = FALSE;
5010 bfd_byte *loc;
5011 int indx;
5012 bfd_vma off;
5013
5014 off = symbol_got_offset (input_bfd, h, r_symndx);
5015 indx = h && h->dynindx != -1 ? h->dynindx : 0;
5016
5017 need_relocs =
5018 (info->shared || indx != 0) &&
5019 (h == NULL
5020 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
5021 || h->root.type != bfd_link_hash_undefweak);
5022
5023 BFD_ASSERT (globals->root.srelgot != NULL);
5024
5025 if (need_relocs)
5026 {
5027 Elf_Internal_Rela rela;
5028 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLS_DTPMOD));
5029 rela.r_addend = 0;
5030 rela.r_offset = globals->root.sgot->output_section->vma +
5031 globals->root.sgot->output_offset + off;
5032
5033
5034 loc = globals->root.srelgot->contents;
5035 loc += globals->root.srelgot->reloc_count++
5036 * RELOC_SIZE (htab);
5037 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
5038
5039 if (indx == 0)
5040 {
5041 bfd_put_NN (output_bfd,
5042 relocation - dtpoff_base (info),
5043 globals->root.sgot->contents + off
5044 + GOT_ENTRY_SIZE);
5045 }
5046 else
5047 {
5048 /* This TLS symbol is global. We emit a
5049 relocation to fixup the tls offset at load
5050 time. */
5051 rela.r_info =
5052 ELFNN_R_INFO (indx, AARCH64_R (TLS_DTPREL));
5053 rela.r_addend = 0;
5054 rela.r_offset =
5055 (globals->root.sgot->output_section->vma
5056 + globals->root.sgot->output_offset + off
5057 + GOT_ENTRY_SIZE);
5058
5059 loc = globals->root.srelgot->contents;
5060 loc += globals->root.srelgot->reloc_count++
5061 * RELOC_SIZE (globals);
5062 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
5063 bfd_put_NN (output_bfd, (bfd_vma) 0,
5064 globals->root.sgot->contents + off
5065 + GOT_ENTRY_SIZE);
5066 }
5067 }
5068 else
5069 {
5070 bfd_put_NN (output_bfd, (bfd_vma) 1,
5071 globals->root.sgot->contents + off);
5072 bfd_put_NN (output_bfd,
5073 relocation - dtpoff_base (info),
5074 globals->root.sgot->contents + off
5075 + GOT_ENTRY_SIZE);
5076 }
5077
5078 symbol_got_offset_mark (input_bfd, h, r_symndx);
5079 }
5080 break;
5081
5082 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
5083 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
5084 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
5085 if (! symbol_got_offset_mark_p (input_bfd, h, r_symndx))
5086 {
5087 bfd_boolean need_relocs = FALSE;
5088 bfd_byte *loc;
5089 int indx;
5090 bfd_vma off;
5091
5092 off = symbol_got_offset (input_bfd, h, r_symndx);
5093
5094 indx = h && h->dynindx != -1 ? h->dynindx : 0;
5095
5096 need_relocs =
5097 (info->shared || indx != 0) &&
5098 (h == NULL
5099 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
5100 || h->root.type != bfd_link_hash_undefweak);
5101
5102 BFD_ASSERT (globals->root.srelgot != NULL);
5103
5104 if (need_relocs)
5105 {
5106 Elf_Internal_Rela rela;
5107
5108 if (indx == 0)
5109 rela.r_addend = relocation - dtpoff_base (info);
5110 else
5111 rela.r_addend = 0;
5112
5113 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLS_TPREL));
5114 rela.r_offset = globals->root.sgot->output_section->vma +
5115 globals->root.sgot->output_offset + off;
5116
5117 loc = globals->root.srelgot->contents;
5118 loc += globals->root.srelgot->reloc_count++
5119 * RELOC_SIZE (htab);
5120
5121 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
5122
5123 bfd_put_NN (output_bfd, rela.r_addend,
5124 globals->root.sgot->contents + off);
5125 }
5126 else
5127 bfd_put_NN (output_bfd, relocation - tpoff_base (info),
5128 globals->root.sgot->contents + off);
5129
5130 symbol_got_offset_mark (input_bfd, h, r_symndx);
5131 }
5132 break;
5133
5134 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
5135 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
5136 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
5137 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
5138 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
5139 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
5140 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
5141 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
5142 break;
5143
5144 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
5145 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
5146 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
5147 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
5148 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
5149 if (! symbol_tlsdesc_got_offset_mark_p (input_bfd, h, r_symndx))
5150 {
5151 bfd_boolean need_relocs = FALSE;
5152 int indx = h && h->dynindx != -1 ? h->dynindx : 0;
5153 bfd_vma off = symbol_tlsdesc_got_offset (input_bfd, h, r_symndx);
5154
5155 need_relocs = (h == NULL
5156 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
5157 || h->root.type != bfd_link_hash_undefweak);
5158
5159 BFD_ASSERT (globals->root.srelgot != NULL);
5160 BFD_ASSERT (globals->root.sgot != NULL);
5161
5162 if (need_relocs)
5163 {
5164 bfd_byte *loc;
5165 Elf_Internal_Rela rela;
5166 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLSDESC));
5167
5168 rela.r_addend = 0;
5169 rela.r_offset = (globals->root.sgotplt->output_section->vma
5170 + globals->root.sgotplt->output_offset
5171 + off + globals->sgotplt_jump_table_size);
5172
5173 if (indx == 0)
5174 rela.r_addend = relocation - dtpoff_base (info);
5175
5176 /* Allocate the next available slot in the PLT reloc
5177 section to hold our R_AARCH64_TLSDESC, the next
5178 available slot is determined from reloc_count,
5179 which we step. But note, reloc_count was
5180 artifically moved down while allocating slots for
5181 real PLT relocs such that all of the PLT relocs
5182 will fit above the initial reloc_count and the
5183 extra stuff will fit below. */
5184 loc = globals->root.srelplt->contents;
5185 loc += globals->root.srelplt->reloc_count++
5186 * RELOC_SIZE (globals);
5187
5188 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
5189
5190 bfd_put_NN (output_bfd, (bfd_vma) 0,
5191 globals->root.sgotplt->contents + off +
5192 globals->sgotplt_jump_table_size);
5193 bfd_put_NN (output_bfd, (bfd_vma) 0,
5194 globals->root.sgotplt->contents + off +
5195 globals->sgotplt_jump_table_size +
5196 GOT_ENTRY_SIZE);
5197 }
5198
5199 symbol_tlsdesc_got_offset_mark (input_bfd, h, r_symndx);
5200 }
5201 break;
5202 default:
5203 break;
5204 }
5205
5206 if (!save_addend)
5207 addend = 0;
5208
5209
5210 /* Dynamic relocs are not propagated for SEC_DEBUGGING sections
5211 because such sections are not SEC_ALLOC and thus ld.so will
5212 not process them. */
5213 if (unresolved_reloc
5214 && !((input_section->flags & SEC_DEBUGGING) != 0
5215 && h->def_dynamic)
5216 && _bfd_elf_section_offset (output_bfd, info, input_section,
5217 +rel->r_offset) != (bfd_vma) - 1)
5218 {
5219 (*_bfd_error_handler)
5220 (_
5221 ("%B(%A+0x%lx): unresolvable %s relocation against symbol `%s'"),
5222 input_bfd, input_section, (long) rel->r_offset, howto->name,
5223 h->root.root.string);
5224 return FALSE;
5225 }
5226
5227 if (r != bfd_reloc_ok && r != bfd_reloc_continue)
5228 {
5229 switch (r)
5230 {
5231 case bfd_reloc_overflow:
5232 /* If the overflowing reloc was to an undefined symbol,
5233 we have already printed one error message and there
5234 is no point complaining again. */
5235 if ((!h ||
5236 h->root.type != bfd_link_hash_undefined)
5237 && (!((*info->callbacks->reloc_overflow)
5238 (info, (h ? &h->root : NULL), name, howto->name,
5239 (bfd_vma) 0, input_bfd, input_section,
5240 rel->r_offset))))
5241 return FALSE;
5242 break;
5243
5244 case bfd_reloc_undefined:
5245 if (!((*info->callbacks->undefined_symbol)
5246 (info, name, input_bfd, input_section,
5247 rel->r_offset, TRUE)))
5248 return FALSE;
5249 break;
5250
5251 case bfd_reloc_outofrange:
5252 error_message = _("out of range");
5253 goto common_error;
5254
5255 case bfd_reloc_notsupported:
5256 error_message = _("unsupported relocation");
5257 goto common_error;
5258
5259 case bfd_reloc_dangerous:
5260 /* error_message should already be set. */
5261 goto common_error;
5262
5263 default:
5264 error_message = _("unknown error");
5265 /* Fall through. */
5266
5267 common_error:
5268 BFD_ASSERT (error_message != NULL);
5269 if (!((*info->callbacks->reloc_dangerous)
5270 (info, error_message, input_bfd, input_section,
5271 rel->r_offset)))
5272 return FALSE;
5273 break;
5274 }
5275 }
5276 }
5277
5278 return TRUE;
5279 }
5280
5281 /* Set the right machine number. */
5282
5283 static bfd_boolean
5284 elfNN_aarch64_object_p (bfd *abfd)
5285 {
5286 #if ARCH_SIZE == 32
5287 bfd_default_set_arch_mach (abfd, bfd_arch_aarch64, bfd_mach_aarch64_ilp32);
5288 #else
5289 bfd_default_set_arch_mach (abfd, bfd_arch_aarch64, bfd_mach_aarch64);
5290 #endif
5291 return TRUE;
5292 }
5293
5294 /* Function to keep AArch64 specific flags in the ELF header. */
5295
5296 static bfd_boolean
5297 elfNN_aarch64_set_private_flags (bfd *abfd, flagword flags)
5298 {
5299 if (elf_flags_init (abfd) && elf_elfheader (abfd)->e_flags != flags)
5300 {
5301 }
5302 else
5303 {
5304 elf_elfheader (abfd)->e_flags = flags;
5305 elf_flags_init (abfd) = TRUE;
5306 }
5307
5308 return TRUE;
5309 }
5310
5311 /* Merge backend specific data from an object file to the output
5312 object file when linking. */
5313
5314 static bfd_boolean
5315 elfNN_aarch64_merge_private_bfd_data (bfd *ibfd, bfd *obfd)
5316 {
5317 flagword out_flags;
5318 flagword in_flags;
5319 bfd_boolean flags_compatible = TRUE;
5320 asection *sec;
5321
5322 /* Check if we have the same endianess. */
5323 if (!_bfd_generic_verify_endian_match (ibfd, obfd))
5324 return FALSE;
5325
5326 if (!is_aarch64_elf (ibfd) || !is_aarch64_elf (obfd))
5327 return TRUE;
5328
5329 /* The input BFD must have had its flags initialised. */
5330 /* The following seems bogus to me -- The flags are initialized in
5331 the assembler but I don't think an elf_flags_init field is
5332 written into the object. */
5333 /* BFD_ASSERT (elf_flags_init (ibfd)); */
5334
5335 in_flags = elf_elfheader (ibfd)->e_flags;
5336 out_flags = elf_elfheader (obfd)->e_flags;
5337
5338 if (!elf_flags_init (obfd))
5339 {
5340 /* If the input is the default architecture and had the default
5341 flags then do not bother setting the flags for the output
5342 architecture, instead allow future merges to do this. If no
5343 future merges ever set these flags then they will retain their
5344 uninitialised values, which surprise surprise, correspond
5345 to the default values. */
5346 if (bfd_get_arch_info (ibfd)->the_default
5347 && elf_elfheader (ibfd)->e_flags == 0)
5348 return TRUE;
5349
5350 elf_flags_init (obfd) = TRUE;
5351 elf_elfheader (obfd)->e_flags = in_flags;
5352
5353 if (bfd_get_arch (obfd) == bfd_get_arch (ibfd)
5354 && bfd_get_arch_info (obfd)->the_default)
5355 return bfd_set_arch_mach (obfd, bfd_get_arch (ibfd),
5356 bfd_get_mach (ibfd));
5357
5358 return TRUE;
5359 }
5360
5361 /* Identical flags must be compatible. */
5362 if (in_flags == out_flags)
5363 return TRUE;
5364
5365 /* Check to see if the input BFD actually contains any sections. If
5366 not, its flags may not have been initialised either, but it
5367 cannot actually cause any incompatiblity. Do not short-circuit
5368 dynamic objects; their section list may be emptied by
5369 elf_link_add_object_symbols.
5370
5371 Also check to see if there are no code sections in the input.
5372 In this case there is no need to check for code specific flags.
5373 XXX - do we need to worry about floating-point format compatability
5374 in data sections ? */
5375 if (!(ibfd->flags & DYNAMIC))
5376 {
5377 bfd_boolean null_input_bfd = TRUE;
5378 bfd_boolean only_data_sections = TRUE;
5379
5380 for (sec = ibfd->sections; sec != NULL; sec = sec->next)
5381 {
5382 if ((bfd_get_section_flags (ibfd, sec)
5383 & (SEC_LOAD | SEC_CODE | SEC_HAS_CONTENTS))
5384 == (SEC_LOAD | SEC_CODE | SEC_HAS_CONTENTS))
5385 only_data_sections = FALSE;
5386
5387 null_input_bfd = FALSE;
5388 break;
5389 }
5390
5391 if (null_input_bfd || only_data_sections)
5392 return TRUE;
5393 }
5394
5395 return flags_compatible;
5396 }
5397
5398 /* Display the flags field. */
5399
5400 static bfd_boolean
5401 elfNN_aarch64_print_private_bfd_data (bfd *abfd, void *ptr)
5402 {
5403 FILE *file = (FILE *) ptr;
5404 unsigned long flags;
5405
5406 BFD_ASSERT (abfd != NULL && ptr != NULL);
5407
5408 /* Print normal ELF private data. */
5409 _bfd_elf_print_private_bfd_data (abfd, ptr);
5410
5411 flags = elf_elfheader (abfd)->e_flags;
5412 /* Ignore init flag - it may not be set, despite the flags field
5413 containing valid data. */
5414
5415 /* xgettext:c-format */
5416 fprintf (file, _("private flags = %lx:"), elf_elfheader (abfd)->e_flags);
5417
5418 if (flags)
5419 fprintf (file, _("<Unrecognised flag bits set>"));
5420
5421 fputc ('\n', file);
5422
5423 return TRUE;
5424 }
5425
5426 /* Update the got entry reference counts for the section being removed. */
5427
5428 static bfd_boolean
5429 elfNN_aarch64_gc_sweep_hook (bfd *abfd,
5430 struct bfd_link_info *info,
5431 asection *sec,
5432 const Elf_Internal_Rela * relocs)
5433 {
5434 struct elf_aarch64_link_hash_table *htab;
5435 Elf_Internal_Shdr *symtab_hdr;
5436 struct elf_link_hash_entry **sym_hashes;
5437 struct elf_aarch64_local_symbol *locals;
5438 const Elf_Internal_Rela *rel, *relend;
5439
5440 if (info->relocatable)
5441 return TRUE;
5442
5443 htab = elf_aarch64_hash_table (info);
5444
5445 if (htab == NULL)
5446 return FALSE;
5447
5448 elf_section_data (sec)->local_dynrel = NULL;
5449
5450 symtab_hdr = &elf_symtab_hdr (abfd);
5451 sym_hashes = elf_sym_hashes (abfd);
5452
5453 locals = elf_aarch64_locals (abfd);
5454
5455 relend = relocs + sec->reloc_count;
5456 for (rel = relocs; rel < relend; rel++)
5457 {
5458 unsigned long r_symndx;
5459 unsigned int r_type;
5460 struct elf_link_hash_entry *h = NULL;
5461
5462 r_symndx = ELFNN_R_SYM (rel->r_info);
5463
5464 if (r_symndx >= symtab_hdr->sh_info)
5465 {
5466
5467 h = sym_hashes[r_symndx - symtab_hdr->sh_info];
5468 while (h->root.type == bfd_link_hash_indirect
5469 || h->root.type == bfd_link_hash_warning)
5470 h = (struct elf_link_hash_entry *) h->root.u.i.link;
5471 }
5472 else
5473 {
5474 Elf_Internal_Sym *isym;
5475
5476 /* A local symbol. */
5477 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
5478 abfd, r_symndx);
5479
5480 /* Check relocation against local STT_GNU_IFUNC symbol. */
5481 if (isym != NULL
5482 && ELF_ST_TYPE (isym->st_info) == STT_GNU_IFUNC)
5483 {
5484 h = elfNN_aarch64_get_local_sym_hash (htab, abfd, rel, FALSE);
5485 if (h == NULL)
5486 abort ();
5487 }
5488 }
5489
5490 if (h)
5491 {
5492 struct elf_aarch64_link_hash_entry *eh;
5493 struct elf_dyn_relocs **pp;
5494 struct elf_dyn_relocs *p;
5495
5496 eh = (struct elf_aarch64_link_hash_entry *) h;
5497
5498 for (pp = &eh->dyn_relocs; (p = *pp) != NULL; pp = &p->next)
5499 if (p->sec == sec)
5500 {
5501 /* Everything must go for SEC. */
5502 *pp = p->next;
5503 break;
5504 }
5505 }
5506
5507 r_type = ELFNN_R_TYPE (rel->r_info);
5508 switch (aarch64_tls_transition (abfd,info, r_type, h ,r_symndx))
5509 {
5510 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
5511 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
5512 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
5513 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
5514 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
5515 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
5516 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
5517 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
5518 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
5519 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
5520 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
5521 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
5522 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
5523 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
5524 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
5525 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
5526 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
5527 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
5528 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
5529 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
5530 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
5531 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
5532 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
5533 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
5534 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
5535 if (h != NULL)
5536 {
5537 if (h->got.refcount > 0)
5538 h->got.refcount -= 1;
5539
5540 if (h->type == STT_GNU_IFUNC)
5541 {
5542 if (h->plt.refcount > 0)
5543 h->plt.refcount -= 1;
5544 }
5545 }
5546 else if (locals != NULL)
5547 {
5548 if (locals[r_symndx].got_refcount > 0)
5549 locals[r_symndx].got_refcount -= 1;
5550 }
5551 break;
5552
5553 case BFD_RELOC_AARCH64_CALL26:
5554 case BFD_RELOC_AARCH64_JUMP26:
5555 /* If this is a local symbol then we resolve it
5556 directly without creating a PLT entry. */
5557 if (h == NULL)
5558 continue;
5559
5560 if (h->plt.refcount > 0)
5561 h->plt.refcount -= 1;
5562 break;
5563
5564 case BFD_RELOC_AARCH64_MOVW_G0_NC:
5565 case BFD_RELOC_AARCH64_MOVW_G1_NC:
5566 case BFD_RELOC_AARCH64_MOVW_G2_NC:
5567 case BFD_RELOC_AARCH64_MOVW_G3:
5568 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
5569 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
5570 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
5571 case BFD_RELOC_AARCH64_NN:
5572 if (h != NULL && info->executable)
5573 {
5574 if (h->plt.refcount > 0)
5575 h->plt.refcount -= 1;
5576 }
5577 break;
5578
5579 default:
5580 break;
5581 }
5582 }
5583
5584 return TRUE;
5585 }
5586
5587 /* Adjust a symbol defined by a dynamic object and referenced by a
5588 regular object. The current definition is in some section of the
5589 dynamic object, but we're not including those sections. We have to
5590 change the definition to something the rest of the link can
5591 understand. */
5592
5593 static bfd_boolean
5594 elfNN_aarch64_adjust_dynamic_symbol (struct bfd_link_info *info,
5595 struct elf_link_hash_entry *h)
5596 {
5597 struct elf_aarch64_link_hash_table *htab;
5598 asection *s;
5599
5600 /* If this is a function, put it in the procedure linkage table. We
5601 will fill in the contents of the procedure linkage table later,
5602 when we know the address of the .got section. */
5603 if (h->type == STT_FUNC || h->type == STT_GNU_IFUNC || h->needs_plt)
5604 {
5605 if (h->plt.refcount <= 0
5606 || (h->type != STT_GNU_IFUNC
5607 && (SYMBOL_CALLS_LOCAL (info, h)
5608 || (ELF_ST_VISIBILITY (h->other) != STV_DEFAULT
5609 && h->root.type == bfd_link_hash_undefweak))))
5610 {
5611 /* This case can occur if we saw a CALL26 reloc in
5612 an input file, but the symbol wasn't referred to
5613 by a dynamic object or all references were
5614 garbage collected. In which case we can end up
5615 resolving. */
5616 h->plt.offset = (bfd_vma) - 1;
5617 h->needs_plt = 0;
5618 }
5619
5620 return TRUE;
5621 }
5622 else
5623 /* It's possible that we incorrectly decided a .plt reloc was
5624 needed for an R_X86_64_PC32 reloc to a non-function sym in
5625 check_relocs. We can't decide accurately between function and
5626 non-function syms in check-relocs; Objects loaded later in
5627 the link may change h->type. So fix it now. */
5628 h->plt.offset = (bfd_vma) - 1;
5629
5630
5631 /* If this is a weak symbol, and there is a real definition, the
5632 processor independent code will have arranged for us to see the
5633 real definition first, and we can just use the same value. */
5634 if (h->u.weakdef != NULL)
5635 {
5636 BFD_ASSERT (h->u.weakdef->root.type == bfd_link_hash_defined
5637 || h->u.weakdef->root.type == bfd_link_hash_defweak);
5638 h->root.u.def.section = h->u.weakdef->root.u.def.section;
5639 h->root.u.def.value = h->u.weakdef->root.u.def.value;
5640 if (ELIMINATE_COPY_RELOCS || info->nocopyreloc)
5641 h->non_got_ref = h->u.weakdef->non_got_ref;
5642 return TRUE;
5643 }
5644
5645 /* If we are creating a shared library, we must presume that the
5646 only references to the symbol are via the global offset table.
5647 For such cases we need not do anything here; the relocations will
5648 be handled correctly by relocate_section. */
5649 if (info->shared)
5650 return TRUE;
5651
5652 /* If there are no references to this symbol that do not use the
5653 GOT, we don't need to generate a copy reloc. */
5654 if (!h->non_got_ref)
5655 return TRUE;
5656
5657 /* If -z nocopyreloc was given, we won't generate them either. */
5658 if (info->nocopyreloc)
5659 {
5660 h->non_got_ref = 0;
5661 return TRUE;
5662 }
5663
5664 /* We must allocate the symbol in our .dynbss section, which will
5665 become part of the .bss section of the executable. There will be
5666 an entry for this symbol in the .dynsym section. The dynamic
5667 object will contain position independent code, so all references
5668 from the dynamic object to this symbol will go through the global
5669 offset table. The dynamic linker will use the .dynsym entry to
5670 determine the address it must put in the global offset table, so
5671 both the dynamic object and the regular object will refer to the
5672 same memory location for the variable. */
5673
5674 htab = elf_aarch64_hash_table (info);
5675
5676 /* We must generate a R_AARCH64_COPY reloc to tell the dynamic linker
5677 to copy the initial value out of the dynamic object and into the
5678 runtime process image. */
5679 if ((h->root.u.def.section->flags & SEC_ALLOC) != 0 && h->size != 0)
5680 {
5681 htab->srelbss->size += RELOC_SIZE (htab);
5682 h->needs_copy = 1;
5683 }
5684
5685 s = htab->sdynbss;
5686
5687 return _bfd_elf_adjust_dynamic_copy (info, h, s);
5688
5689 }
5690
5691 static bfd_boolean
5692 elfNN_aarch64_allocate_local_symbols (bfd *abfd, unsigned number)
5693 {
5694 struct elf_aarch64_local_symbol *locals;
5695 locals = elf_aarch64_locals (abfd);
5696 if (locals == NULL)
5697 {
5698 locals = (struct elf_aarch64_local_symbol *)
5699 bfd_zalloc (abfd, number * sizeof (struct elf_aarch64_local_symbol));
5700 if (locals == NULL)
5701 return FALSE;
5702 elf_aarch64_locals (abfd) = locals;
5703 }
5704 return TRUE;
5705 }
5706
5707 /* Create the .got section to hold the global offset table. */
5708
5709 static bfd_boolean
5710 aarch64_elf_create_got_section (bfd *abfd, struct bfd_link_info *info)
5711 {
5712 const struct elf_backend_data *bed = get_elf_backend_data (abfd);
5713 flagword flags;
5714 asection *s;
5715 struct elf_link_hash_entry *h;
5716 struct elf_link_hash_table *htab = elf_hash_table (info);
5717
5718 /* This function may be called more than once. */
5719 s = bfd_get_linker_section (abfd, ".got");
5720 if (s != NULL)
5721 return TRUE;
5722
5723 flags = bed->dynamic_sec_flags;
5724
5725 s = bfd_make_section_anyway_with_flags (abfd,
5726 (bed->rela_plts_and_copies_p
5727 ? ".rela.got" : ".rel.got"),
5728 (bed->dynamic_sec_flags
5729 | SEC_READONLY));
5730 if (s == NULL
5731 || ! bfd_set_section_alignment (abfd, s, bed->s->log_file_align))
5732 return FALSE;
5733 htab->srelgot = s;
5734
5735 s = bfd_make_section_anyway_with_flags (abfd, ".got", flags);
5736 if (s == NULL
5737 || !bfd_set_section_alignment (abfd, s, bed->s->log_file_align))
5738 return FALSE;
5739 htab->sgot = s;
5740 htab->sgot->size += GOT_ENTRY_SIZE;
5741
5742 if (bed->want_got_sym)
5743 {
5744 /* Define the symbol _GLOBAL_OFFSET_TABLE_ at the start of the .got
5745 (or .got.plt) section. We don't do this in the linker script
5746 because we don't want to define the symbol if we are not creating
5747 a global offset table. */
5748 h = _bfd_elf_define_linkage_sym (abfd, info, s,
5749 "_GLOBAL_OFFSET_TABLE_");
5750 elf_hash_table (info)->hgot = h;
5751 if (h == NULL)
5752 return FALSE;
5753 }
5754
5755 if (bed->want_got_plt)
5756 {
5757 s = bfd_make_section_anyway_with_flags (abfd, ".got.plt", flags);
5758 if (s == NULL
5759 || !bfd_set_section_alignment (abfd, s,
5760 bed->s->log_file_align))
5761 return FALSE;
5762 htab->sgotplt = s;
5763 }
5764
5765 /* The first bit of the global offset table is the header. */
5766 s->size += bed->got_header_size;
5767
5768 return TRUE;
5769 }
5770
5771 /* Look through the relocs for a section during the first phase. */
5772
5773 static bfd_boolean
5774 elfNN_aarch64_check_relocs (bfd *abfd, struct bfd_link_info *info,
5775 asection *sec, const Elf_Internal_Rela *relocs)
5776 {
5777 Elf_Internal_Shdr *symtab_hdr;
5778 struct elf_link_hash_entry **sym_hashes;
5779 const Elf_Internal_Rela *rel;
5780 const Elf_Internal_Rela *rel_end;
5781 asection *sreloc;
5782
5783 struct elf_aarch64_link_hash_table *htab;
5784
5785 if (info->relocatable)
5786 return TRUE;
5787
5788 BFD_ASSERT (is_aarch64_elf (abfd));
5789
5790 htab = elf_aarch64_hash_table (info);
5791 sreloc = NULL;
5792
5793 symtab_hdr = &elf_symtab_hdr (abfd);
5794 sym_hashes = elf_sym_hashes (abfd);
5795
5796 rel_end = relocs + sec->reloc_count;
5797 for (rel = relocs; rel < rel_end; rel++)
5798 {
5799 struct elf_link_hash_entry *h;
5800 unsigned long r_symndx;
5801 unsigned int r_type;
5802 bfd_reloc_code_real_type bfd_r_type;
5803 Elf_Internal_Sym *isym;
5804
5805 r_symndx = ELFNN_R_SYM (rel->r_info);
5806 r_type = ELFNN_R_TYPE (rel->r_info);
5807
5808 if (r_symndx >= NUM_SHDR_ENTRIES (symtab_hdr))
5809 {
5810 (*_bfd_error_handler) (_("%B: bad symbol index: %d"), abfd,
5811 r_symndx);
5812 return FALSE;
5813 }
5814
5815 if (r_symndx < symtab_hdr->sh_info)
5816 {
5817 /* A local symbol. */
5818 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
5819 abfd, r_symndx);
5820 if (isym == NULL)
5821 return FALSE;
5822
5823 /* Check relocation against local STT_GNU_IFUNC symbol. */
5824 if (ELF_ST_TYPE (isym->st_info) == STT_GNU_IFUNC)
5825 {
5826 h = elfNN_aarch64_get_local_sym_hash (htab, abfd, rel,
5827 TRUE);
5828 if (h == NULL)
5829 return FALSE;
5830
5831 /* Fake a STT_GNU_IFUNC symbol. */
5832 h->type = STT_GNU_IFUNC;
5833 h->def_regular = 1;
5834 h->ref_regular = 1;
5835 h->forced_local = 1;
5836 h->root.type = bfd_link_hash_defined;
5837 }
5838 else
5839 h = NULL;
5840 }
5841 else
5842 {
5843 h = sym_hashes[r_symndx - symtab_hdr->sh_info];
5844 while (h->root.type == bfd_link_hash_indirect
5845 || h->root.type == bfd_link_hash_warning)
5846 h = (struct elf_link_hash_entry *) h->root.u.i.link;
5847
5848 /* PR15323, ref flags aren't set for references in the same
5849 object. */
5850 h->root.non_ir_ref = 1;
5851 }
5852
5853 /* Could be done earlier, if h were already available. */
5854 bfd_r_type = aarch64_tls_transition (abfd, info, r_type, h, r_symndx);
5855
5856 if (h != NULL)
5857 {
5858 /* Create the ifunc sections for static executables. If we
5859 never see an indirect function symbol nor we are building
5860 a static executable, those sections will be empty and
5861 won't appear in output. */
5862 switch (bfd_r_type)
5863 {
5864 default:
5865 break;
5866
5867 case BFD_RELOC_AARCH64_NN:
5868 case BFD_RELOC_AARCH64_CALL26:
5869 case BFD_RELOC_AARCH64_JUMP26:
5870 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
5871 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
5872 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
5873 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
5874 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
5875 case BFD_RELOC_AARCH64_ADD_LO12:
5876 if (htab->root.dynobj == NULL)
5877 htab->root.dynobj = abfd;
5878 if (!_bfd_elf_create_ifunc_sections (htab->root.dynobj, info))
5879 return FALSE;
5880 break;
5881 }
5882
5883 /* It is referenced by a non-shared object. */
5884 h->ref_regular = 1;
5885 h->root.non_ir_ref = 1;
5886 }
5887
5888 switch (bfd_r_type)
5889 {
5890 case BFD_RELOC_AARCH64_NN:
5891
5892 /* We don't need to handle relocs into sections not going into
5893 the "real" output. */
5894 if ((sec->flags & SEC_ALLOC) == 0)
5895 break;
5896
5897 if (h != NULL)
5898 {
5899 if (!info->shared)
5900 h->non_got_ref = 1;
5901
5902 h->plt.refcount += 1;
5903 h->pointer_equality_needed = 1;
5904 }
5905
5906 /* No need to do anything if we're not creating a shared
5907 object. */
5908 if (! info->shared)
5909 break;
5910
5911 {
5912 struct elf_dyn_relocs *p;
5913 struct elf_dyn_relocs **head;
5914
5915 /* We must copy these reloc types into the output file.
5916 Create a reloc section in dynobj and make room for
5917 this reloc. */
5918 if (sreloc == NULL)
5919 {
5920 if (htab->root.dynobj == NULL)
5921 htab->root.dynobj = abfd;
5922
5923 sreloc = _bfd_elf_make_dynamic_reloc_section
5924 (sec, htab->root.dynobj, LOG_FILE_ALIGN, abfd, /*rela? */ TRUE);
5925
5926 if (sreloc == NULL)
5927 return FALSE;
5928 }
5929
5930 /* If this is a global symbol, we count the number of
5931 relocations we need for this symbol. */
5932 if (h != NULL)
5933 {
5934 struct elf_aarch64_link_hash_entry *eh;
5935 eh = (struct elf_aarch64_link_hash_entry *) h;
5936 head = &eh->dyn_relocs;
5937 }
5938 else
5939 {
5940 /* Track dynamic relocs needed for local syms too.
5941 We really need local syms available to do this
5942 easily. Oh well. */
5943
5944 asection *s;
5945 void **vpp;
5946
5947 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
5948 abfd, r_symndx);
5949 if (isym == NULL)
5950 return FALSE;
5951
5952 s = bfd_section_from_elf_index (abfd, isym->st_shndx);
5953 if (s == NULL)
5954 s = sec;
5955
5956 /* Beware of type punned pointers vs strict aliasing
5957 rules. */
5958 vpp = &(elf_section_data (s)->local_dynrel);
5959 head = (struct elf_dyn_relocs **) vpp;
5960 }
5961
5962 p = *head;
5963 if (p == NULL || p->sec != sec)
5964 {
5965 bfd_size_type amt = sizeof *p;
5966 p = ((struct elf_dyn_relocs *)
5967 bfd_zalloc (htab->root.dynobj, amt));
5968 if (p == NULL)
5969 return FALSE;
5970 p->next = *head;
5971 *head = p;
5972 p->sec = sec;
5973 }
5974
5975 p->count += 1;
5976
5977 }
5978 break;
5979
5980 /* RR: We probably want to keep a consistency check that
5981 there are no dangling GOT_PAGE relocs. */
5982 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
5983 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
5984 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
5985 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
5986 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
5987 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
5988 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
5989 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
5990 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
5991 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
5992 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
5993 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
5994 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
5995 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
5996 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
5997 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
5998 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
5999 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
6000 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
6001 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
6002 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
6003 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
6004 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
6005 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
6006 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
6007 {
6008 unsigned got_type;
6009 unsigned old_got_type;
6010
6011 got_type = aarch64_reloc_got_type (bfd_r_type);
6012
6013 if (h)
6014 {
6015 h->got.refcount += 1;
6016 old_got_type = elf_aarch64_hash_entry (h)->got_type;
6017 }
6018 else
6019 {
6020 struct elf_aarch64_local_symbol *locals;
6021
6022 if (!elfNN_aarch64_allocate_local_symbols
6023 (abfd, symtab_hdr->sh_info))
6024 return FALSE;
6025
6026 locals = elf_aarch64_locals (abfd);
6027 BFD_ASSERT (r_symndx < symtab_hdr->sh_info);
6028 locals[r_symndx].got_refcount += 1;
6029 old_got_type = locals[r_symndx].got_type;
6030 }
6031
6032 /* If a variable is accessed with both general dynamic TLS
6033 methods, two slots may be created. */
6034 if (GOT_TLS_GD_ANY_P (old_got_type) && GOT_TLS_GD_ANY_P (got_type))
6035 got_type |= old_got_type;
6036
6037 /* We will already have issued an error message if there
6038 is a TLS/non-TLS mismatch, based on the symbol type.
6039 So just combine any TLS types needed. */
6040 if (old_got_type != GOT_UNKNOWN && old_got_type != GOT_NORMAL
6041 && got_type != GOT_NORMAL)
6042 got_type |= old_got_type;
6043
6044 /* If the symbol is accessed by both IE and GD methods, we
6045 are able to relax. Turn off the GD flag, without
6046 messing up with any other kind of TLS types that may be
6047 involved. */
6048 if ((got_type & GOT_TLS_IE) && GOT_TLS_GD_ANY_P (got_type))
6049 got_type &= ~ (GOT_TLSDESC_GD | GOT_TLS_GD);
6050
6051 if (old_got_type != got_type)
6052 {
6053 if (h != NULL)
6054 elf_aarch64_hash_entry (h)->got_type = got_type;
6055 else
6056 {
6057 struct elf_aarch64_local_symbol *locals;
6058 locals = elf_aarch64_locals (abfd);
6059 BFD_ASSERT (r_symndx < symtab_hdr->sh_info);
6060 locals[r_symndx].got_type = got_type;
6061 }
6062 }
6063
6064 if (htab->root.dynobj == NULL)
6065 htab->root.dynobj = abfd;
6066 if (! aarch64_elf_create_got_section (htab->root.dynobj, info))
6067 return FALSE;
6068 break;
6069 }
6070
6071 case BFD_RELOC_AARCH64_MOVW_G0_NC:
6072 case BFD_RELOC_AARCH64_MOVW_G1_NC:
6073 case BFD_RELOC_AARCH64_MOVW_G2_NC:
6074 case BFD_RELOC_AARCH64_MOVW_G3:
6075 if (info->shared)
6076 {
6077 int howto_index = bfd_r_type - BFD_RELOC_AARCH64_RELOC_START;
6078 (*_bfd_error_handler)
6079 (_("%B: relocation %s against `%s' can not be used when making "
6080 "a shared object; recompile with -fPIC"),
6081 abfd, elfNN_aarch64_howto_table[howto_index].name,
6082 (h) ? h->root.root.string : "a local symbol");
6083 bfd_set_error (bfd_error_bad_value);
6084 return FALSE;
6085 }
6086
6087 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
6088 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
6089 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
6090 if (h != NULL && info->executable)
6091 {
6092 /* If this reloc is in a read-only section, we might
6093 need a copy reloc. We can't check reliably at this
6094 stage whether the section is read-only, as input
6095 sections have not yet been mapped to output sections.
6096 Tentatively set the flag for now, and correct in
6097 adjust_dynamic_symbol. */
6098 h->non_got_ref = 1;
6099 h->plt.refcount += 1;
6100 h->pointer_equality_needed = 1;
6101 }
6102 /* FIXME:: RR need to handle these in shared libraries
6103 and essentially bomb out as these being non-PIC
6104 relocations in shared libraries. */
6105 break;
6106
6107 case BFD_RELOC_AARCH64_CALL26:
6108 case BFD_RELOC_AARCH64_JUMP26:
6109 /* If this is a local symbol then we resolve it
6110 directly without creating a PLT entry. */
6111 if (h == NULL)
6112 continue;
6113
6114 h->needs_plt = 1;
6115 if (h->plt.refcount <= 0)
6116 h->plt.refcount = 1;
6117 else
6118 h->plt.refcount += 1;
6119 break;
6120
6121 default:
6122 break;
6123 }
6124 }
6125
6126 return TRUE;
6127 }
6128
6129 /* Treat mapping symbols as special target symbols. */
6130
6131 static bfd_boolean
6132 elfNN_aarch64_is_target_special_symbol (bfd *abfd ATTRIBUTE_UNUSED,
6133 asymbol *sym)
6134 {
6135 return bfd_is_aarch64_special_symbol_name (sym->name,
6136 BFD_AARCH64_SPECIAL_SYM_TYPE_ANY);
6137 }
6138
6139 /* This is a copy of elf_find_function () from elf.c except that
6140 AArch64 mapping symbols are ignored when looking for function names. */
6141
6142 static bfd_boolean
6143 aarch64_elf_find_function (bfd *abfd ATTRIBUTE_UNUSED,
6144 asymbol **symbols,
6145 asection *section,
6146 bfd_vma offset,
6147 const char **filename_ptr,
6148 const char **functionname_ptr)
6149 {
6150 const char *filename = NULL;
6151 asymbol *func = NULL;
6152 bfd_vma low_func = 0;
6153 asymbol **p;
6154
6155 for (p = symbols; *p != NULL; p++)
6156 {
6157 elf_symbol_type *q;
6158
6159 q = (elf_symbol_type *) * p;
6160
6161 switch (ELF_ST_TYPE (q->internal_elf_sym.st_info))
6162 {
6163 default:
6164 break;
6165 case STT_FILE:
6166 filename = bfd_asymbol_name (&q->symbol);
6167 break;
6168 case STT_FUNC:
6169 case STT_NOTYPE:
6170 /* Skip mapping symbols. */
6171 if ((q->symbol.flags & BSF_LOCAL)
6172 && (bfd_is_aarch64_special_symbol_name
6173 (q->symbol.name, BFD_AARCH64_SPECIAL_SYM_TYPE_ANY)))
6174 continue;
6175 /* Fall through. */
6176 if (bfd_get_section (&q->symbol) == section
6177 && q->symbol.value >= low_func && q->symbol.value <= offset)
6178 {
6179 func = (asymbol *) q;
6180 low_func = q->symbol.value;
6181 }
6182 break;
6183 }
6184 }
6185
6186 if (func == NULL)
6187 return FALSE;
6188
6189 if (filename_ptr)
6190 *filename_ptr = filename;
6191 if (functionname_ptr)
6192 *functionname_ptr = bfd_asymbol_name (func);
6193
6194 return TRUE;
6195 }
6196
6197
6198 /* Find the nearest line to a particular section and offset, for error
6199 reporting. This code is a duplicate of the code in elf.c, except
6200 that it uses aarch64_elf_find_function. */
6201
6202 static bfd_boolean
6203 elfNN_aarch64_find_nearest_line (bfd *abfd,
6204 asymbol **symbols,
6205 asection *section,
6206 bfd_vma offset,
6207 const char **filename_ptr,
6208 const char **functionname_ptr,
6209 unsigned int *line_ptr,
6210 unsigned int *discriminator_ptr)
6211 {
6212 bfd_boolean found = FALSE;
6213
6214 if (_bfd_dwarf2_find_nearest_line (abfd, symbols, NULL, section, offset,
6215 filename_ptr, functionname_ptr,
6216 line_ptr, discriminator_ptr,
6217 dwarf_debug_sections, 0,
6218 &elf_tdata (abfd)->dwarf2_find_line_info))
6219 {
6220 if (!*functionname_ptr)
6221 aarch64_elf_find_function (abfd, symbols, section, offset,
6222 *filename_ptr ? NULL : filename_ptr,
6223 functionname_ptr);
6224
6225 return TRUE;
6226 }
6227
6228 /* Skip _bfd_dwarf1_find_nearest_line since no known AArch64
6229 toolchain uses DWARF1. */
6230
6231 if (!_bfd_stab_section_find_nearest_line (abfd, symbols, section, offset,
6232 &found, filename_ptr,
6233 functionname_ptr, line_ptr,
6234 &elf_tdata (abfd)->line_info))
6235 return FALSE;
6236
6237 if (found && (*functionname_ptr || *line_ptr))
6238 return TRUE;
6239
6240 if (symbols == NULL)
6241 return FALSE;
6242
6243 if (!aarch64_elf_find_function (abfd, symbols, section, offset,
6244 filename_ptr, functionname_ptr))
6245 return FALSE;
6246
6247 *line_ptr = 0;
6248 return TRUE;
6249 }
6250
6251 static bfd_boolean
6252 elfNN_aarch64_find_inliner_info (bfd *abfd,
6253 const char **filename_ptr,
6254 const char **functionname_ptr,
6255 unsigned int *line_ptr)
6256 {
6257 bfd_boolean found;
6258 found = _bfd_dwarf2_find_inliner_info
6259 (abfd, filename_ptr,
6260 functionname_ptr, line_ptr, &elf_tdata (abfd)->dwarf2_find_line_info);
6261 return found;
6262 }
6263
6264
6265 static void
6266 elfNN_aarch64_post_process_headers (bfd *abfd,
6267 struct bfd_link_info *link_info)
6268 {
6269 Elf_Internal_Ehdr *i_ehdrp; /* ELF file header, internal form. */
6270
6271 i_ehdrp = elf_elfheader (abfd);
6272 i_ehdrp->e_ident[EI_ABIVERSION] = AARCH64_ELF_ABI_VERSION;
6273
6274 _bfd_elf_post_process_headers (abfd, link_info);
6275 }
6276
6277 static enum elf_reloc_type_class
6278 elfNN_aarch64_reloc_type_class (const struct bfd_link_info *info ATTRIBUTE_UNUSED,
6279 const asection *rel_sec ATTRIBUTE_UNUSED,
6280 const Elf_Internal_Rela *rela)
6281 {
6282 switch ((int) ELFNN_R_TYPE (rela->r_info))
6283 {
6284 case AARCH64_R (RELATIVE):
6285 return reloc_class_relative;
6286 case AARCH64_R (JUMP_SLOT):
6287 return reloc_class_plt;
6288 case AARCH64_R (COPY):
6289 return reloc_class_copy;
6290 default:
6291 return reloc_class_normal;
6292 }
6293 }
6294
6295 /* Handle an AArch64 specific section when reading an object file. This is
6296 called when bfd_section_from_shdr finds a section with an unknown
6297 type. */
6298
6299 static bfd_boolean
6300 elfNN_aarch64_section_from_shdr (bfd *abfd,
6301 Elf_Internal_Shdr *hdr,
6302 const char *name, int shindex)
6303 {
6304 /* There ought to be a place to keep ELF backend specific flags, but
6305 at the moment there isn't one. We just keep track of the
6306 sections by their name, instead. Fortunately, the ABI gives
6307 names for all the AArch64 specific sections, so we will probably get
6308 away with this. */
6309 switch (hdr->sh_type)
6310 {
6311 case SHT_AARCH64_ATTRIBUTES:
6312 break;
6313
6314 default:
6315 return FALSE;
6316 }
6317
6318 if (!_bfd_elf_make_section_from_shdr (abfd, hdr, name, shindex))
6319 return FALSE;
6320
6321 return TRUE;
6322 }
6323
6324 /* A structure used to record a list of sections, independently
6325 of the next and prev fields in the asection structure. */
6326 typedef struct section_list
6327 {
6328 asection *sec;
6329 struct section_list *next;
6330 struct section_list *prev;
6331 }
6332 section_list;
6333
6334 /* Unfortunately we need to keep a list of sections for which
6335 an _aarch64_elf_section_data structure has been allocated. This
6336 is because it is possible for functions like elfNN_aarch64_write_section
6337 to be called on a section which has had an elf_data_structure
6338 allocated for it (and so the used_by_bfd field is valid) but
6339 for which the AArch64 extended version of this structure - the
6340 _aarch64_elf_section_data structure - has not been allocated. */
6341 static section_list *sections_with_aarch64_elf_section_data = NULL;
6342
6343 static void
6344 record_section_with_aarch64_elf_section_data (asection *sec)
6345 {
6346 struct section_list *entry;
6347
6348 entry = bfd_malloc (sizeof (*entry));
6349 if (entry == NULL)
6350 return;
6351 entry->sec = sec;
6352 entry->next = sections_with_aarch64_elf_section_data;
6353 entry->prev = NULL;
6354 if (entry->next != NULL)
6355 entry->next->prev = entry;
6356 sections_with_aarch64_elf_section_data = entry;
6357 }
6358
6359 static struct section_list *
6360 find_aarch64_elf_section_entry (asection *sec)
6361 {
6362 struct section_list *entry;
6363 static struct section_list *last_entry = NULL;
6364
6365 /* This is a short cut for the typical case where the sections are added
6366 to the sections_with_aarch64_elf_section_data list in forward order and
6367 then looked up here in backwards order. This makes a real difference
6368 to the ld-srec/sec64k.exp linker test. */
6369 entry = sections_with_aarch64_elf_section_data;
6370 if (last_entry != NULL)
6371 {
6372 if (last_entry->sec == sec)
6373 entry = last_entry;
6374 else if (last_entry->next != NULL && last_entry->next->sec == sec)
6375 entry = last_entry->next;
6376 }
6377
6378 for (; entry; entry = entry->next)
6379 if (entry->sec == sec)
6380 break;
6381
6382 if (entry)
6383 /* Record the entry prior to this one - it is the entry we are
6384 most likely to want to locate next time. Also this way if we
6385 have been called from
6386 unrecord_section_with_aarch64_elf_section_data () we will not
6387 be caching a pointer that is about to be freed. */
6388 last_entry = entry->prev;
6389
6390 return entry;
6391 }
6392
6393 static void
6394 unrecord_section_with_aarch64_elf_section_data (asection *sec)
6395 {
6396 struct section_list *entry;
6397
6398 entry = find_aarch64_elf_section_entry (sec);
6399
6400 if (entry)
6401 {
6402 if (entry->prev != NULL)
6403 entry->prev->next = entry->next;
6404 if (entry->next != NULL)
6405 entry->next->prev = entry->prev;
6406 if (entry == sections_with_aarch64_elf_section_data)
6407 sections_with_aarch64_elf_section_data = entry->next;
6408 free (entry);
6409 }
6410 }
6411
6412
6413 typedef struct
6414 {
6415 void *finfo;
6416 struct bfd_link_info *info;
6417 asection *sec;
6418 int sec_shndx;
6419 int (*func) (void *, const char *, Elf_Internal_Sym *,
6420 asection *, struct elf_link_hash_entry *);
6421 } output_arch_syminfo;
6422
6423 enum map_symbol_type
6424 {
6425 AARCH64_MAP_INSN,
6426 AARCH64_MAP_DATA
6427 };
6428
6429
6430 /* Output a single mapping symbol. */
6431
6432 static bfd_boolean
6433 elfNN_aarch64_output_map_sym (output_arch_syminfo *osi,
6434 enum map_symbol_type type, bfd_vma offset)
6435 {
6436 static const char *names[2] = { "$x", "$d" };
6437 Elf_Internal_Sym sym;
6438
6439 sym.st_value = (osi->sec->output_section->vma
6440 + osi->sec->output_offset + offset);
6441 sym.st_size = 0;
6442 sym.st_other = 0;
6443 sym.st_info = ELF_ST_INFO (STB_LOCAL, STT_NOTYPE);
6444 sym.st_shndx = osi->sec_shndx;
6445 return osi->func (osi->finfo, names[type], &sym, osi->sec, NULL) == 1;
6446 }
6447
6448
6449
6450 /* Output mapping symbols for PLT entries associated with H. */
6451
6452 static bfd_boolean
6453 elfNN_aarch64_output_plt_map (struct elf_link_hash_entry *h, void *inf)
6454 {
6455 output_arch_syminfo *osi = (output_arch_syminfo *) inf;
6456 bfd_vma addr;
6457
6458 if (h->root.type == bfd_link_hash_indirect)
6459 return TRUE;
6460
6461 if (h->root.type == bfd_link_hash_warning)
6462 /* When warning symbols are created, they **replace** the "real"
6463 entry in the hash table, thus we never get to see the real
6464 symbol in a hash traversal. So look at it now. */
6465 h = (struct elf_link_hash_entry *) h->root.u.i.link;
6466
6467 if (h->plt.offset == (bfd_vma) - 1)
6468 return TRUE;
6469
6470 addr = h->plt.offset;
6471 if (addr == 32)
6472 {
6473 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
6474 return FALSE;
6475 }
6476 return TRUE;
6477 }
6478
6479
6480 /* Output a single local symbol for a generated stub. */
6481
6482 static bfd_boolean
6483 elfNN_aarch64_output_stub_sym (output_arch_syminfo *osi, const char *name,
6484 bfd_vma offset, bfd_vma size)
6485 {
6486 Elf_Internal_Sym sym;
6487
6488 sym.st_value = (osi->sec->output_section->vma
6489 + osi->sec->output_offset + offset);
6490 sym.st_size = size;
6491 sym.st_other = 0;
6492 sym.st_info = ELF_ST_INFO (STB_LOCAL, STT_FUNC);
6493 sym.st_shndx = osi->sec_shndx;
6494 return osi->func (osi->finfo, name, &sym, osi->sec, NULL) == 1;
6495 }
6496
6497 static bfd_boolean
6498 aarch64_map_one_stub (struct bfd_hash_entry *gen_entry, void *in_arg)
6499 {
6500 struct elf_aarch64_stub_hash_entry *stub_entry;
6501 asection *stub_sec;
6502 bfd_vma addr;
6503 char *stub_name;
6504 output_arch_syminfo *osi;
6505
6506 /* Massage our args to the form they really have. */
6507 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
6508 osi = (output_arch_syminfo *) in_arg;
6509
6510 stub_sec = stub_entry->stub_sec;
6511
6512 /* Ensure this stub is attached to the current section being
6513 processed. */
6514 if (stub_sec != osi->sec)
6515 return TRUE;
6516
6517 addr = (bfd_vma) stub_entry->stub_offset;
6518
6519 stub_name = stub_entry->output_name;
6520
6521 switch (stub_entry->stub_type)
6522 {
6523 case aarch64_stub_adrp_branch:
6524 if (!elfNN_aarch64_output_stub_sym (osi, stub_name, addr,
6525 sizeof (aarch64_adrp_branch_stub)))
6526 return FALSE;
6527 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
6528 return FALSE;
6529 break;
6530 case aarch64_stub_long_branch:
6531 if (!elfNN_aarch64_output_stub_sym
6532 (osi, stub_name, addr, sizeof (aarch64_long_branch_stub)))
6533 return FALSE;
6534 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
6535 return FALSE;
6536 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_DATA, addr + 16))
6537 return FALSE;
6538 break;
6539 case aarch64_stub_erratum_835769_veneer:
6540 if (!elfNN_aarch64_output_stub_sym (osi, stub_name, addr,
6541 sizeof (aarch64_erratum_835769_stub)))
6542 return FALSE;
6543 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
6544 return FALSE;
6545 break;
6546 default:
6547 abort ();
6548 }
6549
6550 return TRUE;
6551 }
6552
6553 /* Output mapping symbols for linker generated sections. */
6554
6555 static bfd_boolean
6556 elfNN_aarch64_output_arch_local_syms (bfd *output_bfd,
6557 struct bfd_link_info *info,
6558 void *finfo,
6559 int (*func) (void *, const char *,
6560 Elf_Internal_Sym *,
6561 asection *,
6562 struct elf_link_hash_entry
6563 *))
6564 {
6565 output_arch_syminfo osi;
6566 struct elf_aarch64_link_hash_table *htab;
6567
6568 htab = elf_aarch64_hash_table (info);
6569
6570 osi.finfo = finfo;
6571 osi.info = info;
6572 osi.func = func;
6573
6574 /* Long calls stubs. */
6575 if (htab->stub_bfd && htab->stub_bfd->sections)
6576 {
6577 asection *stub_sec;
6578
6579 for (stub_sec = htab->stub_bfd->sections;
6580 stub_sec != NULL; stub_sec = stub_sec->next)
6581 {
6582 /* Ignore non-stub sections. */
6583 if (!strstr (stub_sec->name, STUB_SUFFIX))
6584 continue;
6585
6586 osi.sec = stub_sec;
6587
6588 osi.sec_shndx = _bfd_elf_section_from_bfd_section
6589 (output_bfd, osi.sec->output_section);
6590
6591 bfd_hash_traverse (&htab->stub_hash_table, aarch64_map_one_stub,
6592 &osi);
6593 }
6594 }
6595
6596 /* Finally, output mapping symbols for the PLT. */
6597 if (!htab->root.splt || htab->root.splt->size == 0)
6598 return TRUE;
6599
6600 /* For now live without mapping symbols for the plt. */
6601 osi.sec_shndx = _bfd_elf_section_from_bfd_section
6602 (output_bfd, htab->root.splt->output_section);
6603 osi.sec = htab->root.splt;
6604
6605 elf_link_hash_traverse (&htab->root, elfNN_aarch64_output_plt_map,
6606 (void *) &osi);
6607
6608 return TRUE;
6609
6610 }
6611
6612 /* Allocate target specific section data. */
6613
6614 static bfd_boolean
6615 elfNN_aarch64_new_section_hook (bfd *abfd, asection *sec)
6616 {
6617 if (!sec->used_by_bfd)
6618 {
6619 _aarch64_elf_section_data *sdata;
6620 bfd_size_type amt = sizeof (*sdata);
6621
6622 sdata = bfd_zalloc (abfd, amt);
6623 if (sdata == NULL)
6624 return FALSE;
6625 sec->used_by_bfd = sdata;
6626 }
6627
6628 record_section_with_aarch64_elf_section_data (sec);
6629
6630 return _bfd_elf_new_section_hook (abfd, sec);
6631 }
6632
6633
6634 static void
6635 unrecord_section_via_map_over_sections (bfd *abfd ATTRIBUTE_UNUSED,
6636 asection *sec,
6637 void *ignore ATTRIBUTE_UNUSED)
6638 {
6639 unrecord_section_with_aarch64_elf_section_data (sec);
6640 }
6641
6642 static bfd_boolean
6643 elfNN_aarch64_close_and_cleanup (bfd *abfd)
6644 {
6645 if (abfd->sections)
6646 bfd_map_over_sections (abfd,
6647 unrecord_section_via_map_over_sections, NULL);
6648
6649 return _bfd_elf_close_and_cleanup (abfd);
6650 }
6651
6652 static bfd_boolean
6653 elfNN_aarch64_bfd_free_cached_info (bfd *abfd)
6654 {
6655 if (abfd->sections)
6656 bfd_map_over_sections (abfd,
6657 unrecord_section_via_map_over_sections, NULL);
6658
6659 return _bfd_free_cached_info (abfd);
6660 }
6661
6662 /* Create dynamic sections. This is different from the ARM backend in that
6663 the got, plt, gotplt and their relocation sections are all created in the
6664 standard part of the bfd elf backend. */
6665
6666 static bfd_boolean
6667 elfNN_aarch64_create_dynamic_sections (bfd *dynobj,
6668 struct bfd_link_info *info)
6669 {
6670 struct elf_aarch64_link_hash_table *htab;
6671
6672 /* We need to create .got section. */
6673 if (!aarch64_elf_create_got_section (dynobj, info))
6674 return FALSE;
6675
6676 if (!_bfd_elf_create_dynamic_sections (dynobj, info))
6677 return FALSE;
6678
6679 htab = elf_aarch64_hash_table (info);
6680 htab->sdynbss = bfd_get_linker_section (dynobj, ".dynbss");
6681 if (!info->shared)
6682 htab->srelbss = bfd_get_linker_section (dynobj, ".rela.bss");
6683
6684 if (!htab->sdynbss || (!info->shared && !htab->srelbss))
6685 abort ();
6686
6687 return TRUE;
6688 }
6689
6690
6691 /* Allocate space in .plt, .got and associated reloc sections for
6692 dynamic relocs. */
6693
6694 static bfd_boolean
6695 elfNN_aarch64_allocate_dynrelocs (struct elf_link_hash_entry *h, void *inf)
6696 {
6697 struct bfd_link_info *info;
6698 struct elf_aarch64_link_hash_table *htab;
6699 struct elf_aarch64_link_hash_entry *eh;
6700 struct elf_dyn_relocs *p;
6701
6702 /* An example of a bfd_link_hash_indirect symbol is versioned
6703 symbol. For example: __gxx_personality_v0(bfd_link_hash_indirect)
6704 -> __gxx_personality_v0(bfd_link_hash_defined)
6705
6706 There is no need to process bfd_link_hash_indirect symbols here
6707 because we will also be presented with the concrete instance of
6708 the symbol and elfNN_aarch64_copy_indirect_symbol () will have been
6709 called to copy all relevant data from the generic to the concrete
6710 symbol instance.
6711 */
6712 if (h->root.type == bfd_link_hash_indirect)
6713 return TRUE;
6714
6715 if (h->root.type == bfd_link_hash_warning)
6716 h = (struct elf_link_hash_entry *) h->root.u.i.link;
6717
6718 info = (struct bfd_link_info *) inf;
6719 htab = elf_aarch64_hash_table (info);
6720
6721 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle it
6722 here if it is defined and referenced in a non-shared object. */
6723 if (h->type == STT_GNU_IFUNC
6724 && h->def_regular)
6725 return TRUE;
6726 else if (htab->root.dynamic_sections_created && h->plt.refcount > 0)
6727 {
6728 /* Make sure this symbol is output as a dynamic symbol.
6729 Undefined weak syms won't yet be marked as dynamic. */
6730 if (h->dynindx == -1 && !h->forced_local)
6731 {
6732 if (!bfd_elf_link_record_dynamic_symbol (info, h))
6733 return FALSE;
6734 }
6735
6736 if (info->shared || WILL_CALL_FINISH_DYNAMIC_SYMBOL (1, 0, h))
6737 {
6738 asection *s = htab->root.splt;
6739
6740 /* If this is the first .plt entry, make room for the special
6741 first entry. */
6742 if (s->size == 0)
6743 s->size += htab->plt_header_size;
6744
6745 h->plt.offset = s->size;
6746
6747 /* If this symbol is not defined in a regular file, and we are
6748 not generating a shared library, then set the symbol to this
6749 location in the .plt. This is required to make function
6750 pointers compare as equal between the normal executable and
6751 the shared library. */
6752 if (!info->shared && !h->def_regular)
6753 {
6754 h->root.u.def.section = s;
6755 h->root.u.def.value = h->plt.offset;
6756 }
6757
6758 /* Make room for this entry. For now we only create the
6759 small model PLT entries. We later need to find a way
6760 of relaxing into these from the large model PLT entries. */
6761 s->size += PLT_SMALL_ENTRY_SIZE;
6762
6763 /* We also need to make an entry in the .got.plt section, which
6764 will be placed in the .got section by the linker script. */
6765 htab->root.sgotplt->size += GOT_ENTRY_SIZE;
6766
6767 /* We also need to make an entry in the .rela.plt section. */
6768 htab->root.srelplt->size += RELOC_SIZE (htab);
6769
6770 /* We need to ensure that all GOT entries that serve the PLT
6771 are consecutive with the special GOT slots [0] [1] and
6772 [2]. Any addtional relocations, such as
6773 R_AARCH64_TLSDESC, must be placed after the PLT related
6774 entries. We abuse the reloc_count such that during
6775 sizing we adjust reloc_count to indicate the number of
6776 PLT related reserved entries. In subsequent phases when
6777 filling in the contents of the reloc entries, PLT related
6778 entries are placed by computing their PLT index (0
6779 .. reloc_count). While other none PLT relocs are placed
6780 at the slot indicated by reloc_count and reloc_count is
6781 updated. */
6782
6783 htab->root.srelplt->reloc_count++;
6784 }
6785 else
6786 {
6787 h->plt.offset = (bfd_vma) - 1;
6788 h->needs_plt = 0;
6789 }
6790 }
6791 else
6792 {
6793 h->plt.offset = (bfd_vma) - 1;
6794 h->needs_plt = 0;
6795 }
6796
6797 eh = (struct elf_aarch64_link_hash_entry *) h;
6798 eh->tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
6799
6800 if (h->got.refcount > 0)
6801 {
6802 bfd_boolean dyn;
6803 unsigned got_type = elf_aarch64_hash_entry (h)->got_type;
6804
6805 h->got.offset = (bfd_vma) - 1;
6806
6807 dyn = htab->root.dynamic_sections_created;
6808
6809 /* Make sure this symbol is output as a dynamic symbol.
6810 Undefined weak syms won't yet be marked as dynamic. */
6811 if (dyn && h->dynindx == -1 && !h->forced_local)
6812 {
6813 if (!bfd_elf_link_record_dynamic_symbol (info, h))
6814 return FALSE;
6815 }
6816
6817 if (got_type == GOT_UNKNOWN)
6818 {
6819 }
6820 else if (got_type == GOT_NORMAL)
6821 {
6822 h->got.offset = htab->root.sgot->size;
6823 htab->root.sgot->size += GOT_ENTRY_SIZE;
6824 if ((ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
6825 || h->root.type != bfd_link_hash_undefweak)
6826 && (info->shared
6827 || WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, 0, h)))
6828 {
6829 htab->root.srelgot->size += RELOC_SIZE (htab);
6830 }
6831 }
6832 else
6833 {
6834 int indx;
6835 if (got_type & GOT_TLSDESC_GD)
6836 {
6837 eh->tlsdesc_got_jump_table_offset =
6838 (htab->root.sgotplt->size
6839 - aarch64_compute_jump_table_size (htab));
6840 htab->root.sgotplt->size += GOT_ENTRY_SIZE * 2;
6841 h->got.offset = (bfd_vma) - 2;
6842 }
6843
6844 if (got_type & GOT_TLS_GD)
6845 {
6846 h->got.offset = htab->root.sgot->size;
6847 htab->root.sgot->size += GOT_ENTRY_SIZE * 2;
6848 }
6849
6850 if (got_type & GOT_TLS_IE)
6851 {
6852 h->got.offset = htab->root.sgot->size;
6853 htab->root.sgot->size += GOT_ENTRY_SIZE;
6854 }
6855
6856 indx = h && h->dynindx != -1 ? h->dynindx : 0;
6857 if ((ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
6858 || h->root.type != bfd_link_hash_undefweak)
6859 && (info->shared
6860 || indx != 0
6861 || WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, 0, h)))
6862 {
6863 if (got_type & GOT_TLSDESC_GD)
6864 {
6865 htab->root.srelplt->size += RELOC_SIZE (htab);
6866 /* Note reloc_count not incremented here! We have
6867 already adjusted reloc_count for this relocation
6868 type. */
6869
6870 /* TLSDESC PLT is now needed, but not yet determined. */
6871 htab->tlsdesc_plt = (bfd_vma) - 1;
6872 }
6873
6874 if (got_type & GOT_TLS_GD)
6875 htab->root.srelgot->size += RELOC_SIZE (htab) * 2;
6876
6877 if (got_type & GOT_TLS_IE)
6878 htab->root.srelgot->size += RELOC_SIZE (htab);
6879 }
6880 }
6881 }
6882 else
6883 {
6884 h->got.offset = (bfd_vma) - 1;
6885 }
6886
6887 if (eh->dyn_relocs == NULL)
6888 return TRUE;
6889
6890 /* In the shared -Bsymbolic case, discard space allocated for
6891 dynamic pc-relative relocs against symbols which turn out to be
6892 defined in regular objects. For the normal shared case, discard
6893 space for pc-relative relocs that have become local due to symbol
6894 visibility changes. */
6895
6896 if (info->shared)
6897 {
6898 /* Relocs that use pc_count are those that appear on a call
6899 insn, or certain REL relocs that can generated via assembly.
6900 We want calls to protected symbols to resolve directly to the
6901 function rather than going via the plt. If people want
6902 function pointer comparisons to work as expected then they
6903 should avoid writing weird assembly. */
6904 if (SYMBOL_CALLS_LOCAL (info, h))
6905 {
6906 struct elf_dyn_relocs **pp;
6907
6908 for (pp = &eh->dyn_relocs; (p = *pp) != NULL;)
6909 {
6910 p->count -= p->pc_count;
6911 p->pc_count = 0;
6912 if (p->count == 0)
6913 *pp = p->next;
6914 else
6915 pp = &p->next;
6916 }
6917 }
6918
6919 /* Also discard relocs on undefined weak syms with non-default
6920 visibility. */
6921 if (eh->dyn_relocs != NULL && h->root.type == bfd_link_hash_undefweak)
6922 {
6923 if (ELF_ST_VISIBILITY (h->other) != STV_DEFAULT)
6924 eh->dyn_relocs = NULL;
6925
6926 /* Make sure undefined weak symbols are output as a dynamic
6927 symbol in PIEs. */
6928 else if (h->dynindx == -1
6929 && !h->forced_local
6930 && !bfd_elf_link_record_dynamic_symbol (info, h))
6931 return FALSE;
6932 }
6933
6934 }
6935 else if (ELIMINATE_COPY_RELOCS)
6936 {
6937 /* For the non-shared case, discard space for relocs against
6938 symbols which turn out to need copy relocs or are not
6939 dynamic. */
6940
6941 if (!h->non_got_ref
6942 && ((h->def_dynamic
6943 && !h->def_regular)
6944 || (htab->root.dynamic_sections_created
6945 && (h->root.type == bfd_link_hash_undefweak
6946 || h->root.type == bfd_link_hash_undefined))))
6947 {
6948 /* Make sure this symbol is output as a dynamic symbol.
6949 Undefined weak syms won't yet be marked as dynamic. */
6950 if (h->dynindx == -1
6951 && !h->forced_local
6952 && !bfd_elf_link_record_dynamic_symbol (info, h))
6953 return FALSE;
6954
6955 /* If that succeeded, we know we'll be keeping all the
6956 relocs. */
6957 if (h->dynindx != -1)
6958 goto keep;
6959 }
6960
6961 eh->dyn_relocs = NULL;
6962
6963 keep:;
6964 }
6965
6966 /* Finally, allocate space. */
6967 for (p = eh->dyn_relocs; p != NULL; p = p->next)
6968 {
6969 asection *sreloc;
6970
6971 sreloc = elf_section_data (p->sec)->sreloc;
6972
6973 BFD_ASSERT (sreloc != NULL);
6974
6975 sreloc->size += p->count * RELOC_SIZE (htab);
6976 }
6977
6978 return TRUE;
6979 }
6980
6981 /* Allocate space in .plt, .got and associated reloc sections for
6982 ifunc dynamic relocs. */
6983
6984 static bfd_boolean
6985 elfNN_aarch64_allocate_ifunc_dynrelocs (struct elf_link_hash_entry *h,
6986 void *inf)
6987 {
6988 struct bfd_link_info *info;
6989 struct elf_aarch64_link_hash_table *htab;
6990 struct elf_aarch64_link_hash_entry *eh;
6991
6992 /* An example of a bfd_link_hash_indirect symbol is versioned
6993 symbol. For example: __gxx_personality_v0(bfd_link_hash_indirect)
6994 -> __gxx_personality_v0(bfd_link_hash_defined)
6995
6996 There is no need to process bfd_link_hash_indirect symbols here
6997 because we will also be presented with the concrete instance of
6998 the symbol and elfNN_aarch64_copy_indirect_symbol () will have been
6999 called to copy all relevant data from the generic to the concrete
7000 symbol instance.
7001 */
7002 if (h->root.type == bfd_link_hash_indirect)
7003 return TRUE;
7004
7005 if (h->root.type == bfd_link_hash_warning)
7006 h = (struct elf_link_hash_entry *) h->root.u.i.link;
7007
7008 info = (struct bfd_link_info *) inf;
7009 htab = elf_aarch64_hash_table (info);
7010
7011 eh = (struct elf_aarch64_link_hash_entry *) h;
7012
7013 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle it
7014 here if it is defined and referenced in a non-shared object. */
7015 if (h->type == STT_GNU_IFUNC
7016 && h->def_regular)
7017 return _bfd_elf_allocate_ifunc_dyn_relocs (info, h,
7018 &eh->dyn_relocs,
7019 htab->plt_entry_size,
7020 htab->plt_header_size,
7021 GOT_ENTRY_SIZE);
7022 return TRUE;
7023 }
7024
7025 /* Allocate space in .plt, .got and associated reloc sections for
7026 local dynamic relocs. */
7027
7028 static bfd_boolean
7029 elfNN_aarch64_allocate_local_dynrelocs (void **slot, void *inf)
7030 {
7031 struct elf_link_hash_entry *h
7032 = (struct elf_link_hash_entry *) *slot;
7033
7034 if (h->type != STT_GNU_IFUNC
7035 || !h->def_regular
7036 || !h->ref_regular
7037 || !h->forced_local
7038 || h->root.type != bfd_link_hash_defined)
7039 abort ();
7040
7041 return elfNN_aarch64_allocate_dynrelocs (h, inf);
7042 }
7043
7044 /* Allocate space in .plt, .got and associated reloc sections for
7045 local ifunc dynamic relocs. */
7046
7047 static bfd_boolean
7048 elfNN_aarch64_allocate_local_ifunc_dynrelocs (void **slot, void *inf)
7049 {
7050 struct elf_link_hash_entry *h
7051 = (struct elf_link_hash_entry *) *slot;
7052
7053 if (h->type != STT_GNU_IFUNC
7054 || !h->def_regular
7055 || !h->ref_regular
7056 || !h->forced_local
7057 || h->root.type != bfd_link_hash_defined)
7058 abort ();
7059
7060 return elfNN_aarch64_allocate_ifunc_dynrelocs (h, inf);
7061 }
7062
7063 /* This is the most important function of all . Innocuosly named
7064 though ! */
7065 static bfd_boolean
7066 elfNN_aarch64_size_dynamic_sections (bfd *output_bfd ATTRIBUTE_UNUSED,
7067 struct bfd_link_info *info)
7068 {
7069 struct elf_aarch64_link_hash_table *htab;
7070 bfd *dynobj;
7071 asection *s;
7072 bfd_boolean relocs;
7073 bfd *ibfd;
7074
7075 htab = elf_aarch64_hash_table ((info));
7076 dynobj = htab->root.dynobj;
7077
7078 BFD_ASSERT (dynobj != NULL);
7079
7080 if (htab->root.dynamic_sections_created)
7081 {
7082 if (info->executable)
7083 {
7084 s = bfd_get_linker_section (dynobj, ".interp");
7085 if (s == NULL)
7086 abort ();
7087 s->size = sizeof ELF_DYNAMIC_INTERPRETER;
7088 s->contents = (unsigned char *) ELF_DYNAMIC_INTERPRETER;
7089 }
7090 }
7091
7092 /* Set up .got offsets for local syms, and space for local dynamic
7093 relocs. */
7094 for (ibfd = info->input_bfds; ibfd != NULL; ibfd = ibfd->link.next)
7095 {
7096 struct elf_aarch64_local_symbol *locals = NULL;
7097 Elf_Internal_Shdr *symtab_hdr;
7098 asection *srel;
7099 unsigned int i;
7100
7101 if (!is_aarch64_elf (ibfd))
7102 continue;
7103
7104 for (s = ibfd->sections; s != NULL; s = s->next)
7105 {
7106 struct elf_dyn_relocs *p;
7107
7108 for (p = (struct elf_dyn_relocs *)
7109 (elf_section_data (s)->local_dynrel); p != NULL; p = p->next)
7110 {
7111 if (!bfd_is_abs_section (p->sec)
7112 && bfd_is_abs_section (p->sec->output_section))
7113 {
7114 /* Input section has been discarded, either because
7115 it is a copy of a linkonce section or due to
7116 linker script /DISCARD/, so we'll be discarding
7117 the relocs too. */
7118 }
7119 else if (p->count != 0)
7120 {
7121 srel = elf_section_data (p->sec)->sreloc;
7122 srel->size += p->count * RELOC_SIZE (htab);
7123 if ((p->sec->output_section->flags & SEC_READONLY) != 0)
7124 info->flags |= DF_TEXTREL;
7125 }
7126 }
7127 }
7128
7129 locals = elf_aarch64_locals (ibfd);
7130 if (!locals)
7131 continue;
7132
7133 symtab_hdr = &elf_symtab_hdr (ibfd);
7134 srel = htab->root.srelgot;
7135 for (i = 0; i < symtab_hdr->sh_info; i++)
7136 {
7137 locals[i].got_offset = (bfd_vma) - 1;
7138 locals[i].tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
7139 if (locals[i].got_refcount > 0)
7140 {
7141 unsigned got_type = locals[i].got_type;
7142 if (got_type & GOT_TLSDESC_GD)
7143 {
7144 locals[i].tlsdesc_got_jump_table_offset =
7145 (htab->root.sgotplt->size
7146 - aarch64_compute_jump_table_size (htab));
7147 htab->root.sgotplt->size += GOT_ENTRY_SIZE * 2;
7148 locals[i].got_offset = (bfd_vma) - 2;
7149 }
7150
7151 if (got_type & GOT_TLS_GD)
7152 {
7153 locals[i].got_offset = htab->root.sgot->size;
7154 htab->root.sgot->size += GOT_ENTRY_SIZE * 2;
7155 }
7156
7157 if (got_type & GOT_TLS_IE)
7158 {
7159 locals[i].got_offset = htab->root.sgot->size;
7160 htab->root.sgot->size += GOT_ENTRY_SIZE;
7161 }
7162
7163 if (got_type == GOT_UNKNOWN)
7164 {
7165 }
7166
7167 if (got_type == GOT_NORMAL)
7168 {
7169 }
7170
7171 if (info->shared)
7172 {
7173 if (got_type & GOT_TLSDESC_GD)
7174 {
7175 htab->root.srelplt->size += RELOC_SIZE (htab);
7176 /* Note RELOC_COUNT not incremented here! */
7177 htab->tlsdesc_plt = (bfd_vma) - 1;
7178 }
7179
7180 if (got_type & GOT_TLS_GD)
7181 htab->root.srelgot->size += RELOC_SIZE (htab) * 2;
7182
7183 if (got_type & GOT_TLS_IE)
7184 htab->root.srelgot->size += RELOC_SIZE (htab);
7185 }
7186 }
7187 else
7188 {
7189 locals[i].got_refcount = (bfd_vma) - 1;
7190 }
7191 }
7192 }
7193
7194
7195 /* Allocate global sym .plt and .got entries, and space for global
7196 sym dynamic relocs. */
7197 elf_link_hash_traverse (&htab->root, elfNN_aarch64_allocate_dynrelocs,
7198 info);
7199
7200 /* Allocate global ifunc sym .plt and .got entries, and space for global
7201 ifunc sym dynamic relocs. */
7202 elf_link_hash_traverse (&htab->root, elfNN_aarch64_allocate_ifunc_dynrelocs,
7203 info);
7204
7205 /* Allocate .plt and .got entries, and space for local symbols. */
7206 htab_traverse (htab->loc_hash_table,
7207 elfNN_aarch64_allocate_local_dynrelocs,
7208 info);
7209
7210 /* Allocate .plt and .got entries, and space for local ifunc symbols. */
7211 htab_traverse (htab->loc_hash_table,
7212 elfNN_aarch64_allocate_local_ifunc_dynrelocs,
7213 info);
7214
7215 /* For every jump slot reserved in the sgotplt, reloc_count is
7216 incremented. However, when we reserve space for TLS descriptors,
7217 it's not incremented, so in order to compute the space reserved
7218 for them, it suffices to multiply the reloc count by the jump
7219 slot size. */
7220
7221 if (htab->root.srelplt)
7222 htab->sgotplt_jump_table_size = aarch64_compute_jump_table_size (htab);
7223
7224 if (htab->tlsdesc_plt)
7225 {
7226 if (htab->root.splt->size == 0)
7227 htab->root.splt->size += PLT_ENTRY_SIZE;
7228
7229 htab->tlsdesc_plt = htab->root.splt->size;
7230 htab->root.splt->size += PLT_TLSDESC_ENTRY_SIZE;
7231
7232 /* If we're not using lazy TLS relocations, don't generate the
7233 GOT entry required. */
7234 if (!(info->flags & DF_BIND_NOW))
7235 {
7236 htab->dt_tlsdesc_got = htab->root.sgot->size;
7237 htab->root.sgot->size += GOT_ENTRY_SIZE;
7238 }
7239 }
7240
7241 /* Init mapping symbols information to use later to distingush between
7242 code and data while scanning for erratam 835769. */
7243 if (htab->fix_erratum_835769)
7244 for (ibfd = info->input_bfds; ibfd != NULL; ibfd = ibfd->link.next)
7245 {
7246 if (!is_aarch64_elf (ibfd))
7247 continue;
7248 bfd_elfNN_aarch64_init_maps (ibfd);
7249 }
7250
7251 /* We now have determined the sizes of the various dynamic sections.
7252 Allocate memory for them. */
7253 relocs = FALSE;
7254 for (s = dynobj->sections; s != NULL; s = s->next)
7255 {
7256 if ((s->flags & SEC_LINKER_CREATED) == 0)
7257 continue;
7258
7259 if (s == htab->root.splt
7260 || s == htab->root.sgot
7261 || s == htab->root.sgotplt
7262 || s == htab->root.iplt
7263 || s == htab->root.igotplt || s == htab->sdynbss)
7264 {
7265 /* Strip this section if we don't need it; see the
7266 comment below. */
7267 }
7268 else if (CONST_STRNEQ (bfd_get_section_name (dynobj, s), ".rela"))
7269 {
7270 if (s->size != 0 && s != htab->root.srelplt)
7271 relocs = TRUE;
7272
7273 /* We use the reloc_count field as a counter if we need
7274 to copy relocs into the output file. */
7275 if (s != htab->root.srelplt)
7276 s->reloc_count = 0;
7277 }
7278 else
7279 {
7280 /* It's not one of our sections, so don't allocate space. */
7281 continue;
7282 }
7283
7284 if (s->size == 0)
7285 {
7286 /* If we don't need this section, strip it from the
7287 output file. This is mostly to handle .rela.bss and
7288 .rela.plt. We must create both sections in
7289 create_dynamic_sections, because they must be created
7290 before the linker maps input sections to output
7291 sections. The linker does that before
7292 adjust_dynamic_symbol is called, and it is that
7293 function which decides whether anything needs to go
7294 into these sections. */
7295
7296 s->flags |= SEC_EXCLUDE;
7297 continue;
7298 }
7299
7300 if ((s->flags & SEC_HAS_CONTENTS) == 0)
7301 continue;
7302
7303 /* Allocate memory for the section contents. We use bfd_zalloc
7304 here in case unused entries are not reclaimed before the
7305 section's contents are written out. This should not happen,
7306 but this way if it does, we get a R_AARCH64_NONE reloc instead
7307 of garbage. */
7308 s->contents = (bfd_byte *) bfd_zalloc (dynobj, s->size);
7309 if (s->contents == NULL)
7310 return FALSE;
7311 }
7312
7313 if (htab->root.dynamic_sections_created)
7314 {
7315 /* Add some entries to the .dynamic section. We fill in the
7316 values later, in elfNN_aarch64_finish_dynamic_sections, but we
7317 must add the entries now so that we get the correct size for
7318 the .dynamic section. The DT_DEBUG entry is filled in by the
7319 dynamic linker and used by the debugger. */
7320 #define add_dynamic_entry(TAG, VAL) \
7321 _bfd_elf_add_dynamic_entry (info, TAG, VAL)
7322
7323 if (info->executable)
7324 {
7325 if (!add_dynamic_entry (DT_DEBUG, 0))
7326 return FALSE;
7327 }
7328
7329 if (htab->root.splt->size != 0)
7330 {
7331 if (!add_dynamic_entry (DT_PLTGOT, 0)
7332 || !add_dynamic_entry (DT_PLTRELSZ, 0)
7333 || !add_dynamic_entry (DT_PLTREL, DT_RELA)
7334 || !add_dynamic_entry (DT_JMPREL, 0))
7335 return FALSE;
7336
7337 if (htab->tlsdesc_plt
7338 && (!add_dynamic_entry (DT_TLSDESC_PLT, 0)
7339 || !add_dynamic_entry (DT_TLSDESC_GOT, 0)))
7340 return FALSE;
7341 }
7342
7343 if (relocs)
7344 {
7345 if (!add_dynamic_entry (DT_RELA, 0)
7346 || !add_dynamic_entry (DT_RELASZ, 0)
7347 || !add_dynamic_entry (DT_RELAENT, RELOC_SIZE (htab)))
7348 return FALSE;
7349
7350 /* If any dynamic relocs apply to a read-only section,
7351 then we need a DT_TEXTREL entry. */
7352 if ((info->flags & DF_TEXTREL) != 0)
7353 {
7354 if (!add_dynamic_entry (DT_TEXTREL, 0))
7355 return FALSE;
7356 }
7357 }
7358 }
7359 #undef add_dynamic_entry
7360
7361 return TRUE;
7362 }
7363
7364 static inline void
7365 elf_aarch64_update_plt_entry (bfd *output_bfd,
7366 bfd_reloc_code_real_type r_type,
7367 bfd_byte *plt_entry, bfd_vma value)
7368 {
7369 reloc_howto_type *howto = elfNN_aarch64_howto_from_bfd_reloc (r_type);
7370
7371 _bfd_aarch64_elf_put_addend (output_bfd, plt_entry, r_type, howto, value);
7372 }
7373
7374 static void
7375 elfNN_aarch64_create_small_pltn_entry (struct elf_link_hash_entry *h,
7376 struct elf_aarch64_link_hash_table
7377 *htab, bfd *output_bfd,
7378 struct bfd_link_info *info)
7379 {
7380 bfd_byte *plt_entry;
7381 bfd_vma plt_index;
7382 bfd_vma got_offset;
7383 bfd_vma gotplt_entry_address;
7384 bfd_vma plt_entry_address;
7385 Elf_Internal_Rela rela;
7386 bfd_byte *loc;
7387 asection *plt, *gotplt, *relplt;
7388
7389 /* When building a static executable, use .iplt, .igot.plt and
7390 .rela.iplt sections for STT_GNU_IFUNC symbols. */
7391 if (htab->root.splt != NULL)
7392 {
7393 plt = htab->root.splt;
7394 gotplt = htab->root.sgotplt;
7395 relplt = htab->root.srelplt;
7396 }
7397 else
7398 {
7399 plt = htab->root.iplt;
7400 gotplt = htab->root.igotplt;
7401 relplt = htab->root.irelplt;
7402 }
7403
7404 /* Get the index in the procedure linkage table which
7405 corresponds to this symbol. This is the index of this symbol
7406 in all the symbols for which we are making plt entries. The
7407 first entry in the procedure linkage table is reserved.
7408
7409 Get the offset into the .got table of the entry that
7410 corresponds to this function. Each .got entry is GOT_ENTRY_SIZE
7411 bytes. The first three are reserved for the dynamic linker.
7412
7413 For static executables, we don't reserve anything. */
7414
7415 if (plt == htab->root.splt)
7416 {
7417 plt_index = (h->plt.offset - htab->plt_header_size) / htab->plt_entry_size;
7418 got_offset = (plt_index + 3) * GOT_ENTRY_SIZE;
7419 }
7420 else
7421 {
7422 plt_index = h->plt.offset / htab->plt_entry_size;
7423 got_offset = plt_index * GOT_ENTRY_SIZE;
7424 }
7425
7426 plt_entry = plt->contents + h->plt.offset;
7427 plt_entry_address = plt->output_section->vma
7428 + plt->output_offset + h->plt.offset;
7429 gotplt_entry_address = gotplt->output_section->vma +
7430 gotplt->output_offset + got_offset;
7431
7432 /* Copy in the boiler-plate for the PLTn entry. */
7433 memcpy (plt_entry, elfNN_aarch64_small_plt_entry, PLT_SMALL_ENTRY_SIZE);
7434
7435 /* Fill in the top 21 bits for this: ADRP x16, PLT_GOT + n * 8.
7436 ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
7437 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADR_HI21_PCREL,
7438 plt_entry,
7439 PG (gotplt_entry_address) -
7440 PG (plt_entry_address));
7441
7442 /* Fill in the lo12 bits for the load from the pltgot. */
7443 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_LDSTNN_LO12,
7444 plt_entry + 4,
7445 PG_OFFSET (gotplt_entry_address));
7446
7447 /* Fill in the lo12 bits for the add from the pltgot entry. */
7448 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADD_LO12,
7449 plt_entry + 8,
7450 PG_OFFSET (gotplt_entry_address));
7451
7452 /* All the GOTPLT Entries are essentially initialized to PLT0. */
7453 bfd_put_NN (output_bfd,
7454 plt->output_section->vma + plt->output_offset,
7455 gotplt->contents + got_offset);
7456
7457 rela.r_offset = gotplt_entry_address;
7458
7459 if (h->dynindx == -1
7460 || ((info->executable
7461 || ELF_ST_VISIBILITY (h->other) != STV_DEFAULT)
7462 && h->def_regular
7463 && h->type == STT_GNU_IFUNC))
7464 {
7465 /* If an STT_GNU_IFUNC symbol is locally defined, generate
7466 R_AARCH64_IRELATIVE instead of R_AARCH64_JUMP_SLOT. */
7467 rela.r_info = ELFNN_R_INFO (0, AARCH64_R (IRELATIVE));
7468 rela.r_addend = (h->root.u.def.value
7469 + h->root.u.def.section->output_section->vma
7470 + h->root.u.def.section->output_offset);
7471 }
7472 else
7473 {
7474 /* Fill in the entry in the .rela.plt section. */
7475 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (JUMP_SLOT));
7476 rela.r_addend = 0;
7477 }
7478
7479 /* Compute the relocation entry to used based on PLT index and do
7480 not adjust reloc_count. The reloc_count has already been adjusted
7481 to account for this entry. */
7482 loc = relplt->contents + plt_index * RELOC_SIZE (htab);
7483 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
7484 }
7485
7486 /* Size sections even though they're not dynamic. We use it to setup
7487 _TLS_MODULE_BASE_, if needed. */
7488
7489 static bfd_boolean
7490 elfNN_aarch64_always_size_sections (bfd *output_bfd,
7491 struct bfd_link_info *info)
7492 {
7493 asection *tls_sec;
7494
7495 if (info->relocatable)
7496 return TRUE;
7497
7498 tls_sec = elf_hash_table (info)->tls_sec;
7499
7500 if (tls_sec)
7501 {
7502 struct elf_link_hash_entry *tlsbase;
7503
7504 tlsbase = elf_link_hash_lookup (elf_hash_table (info),
7505 "_TLS_MODULE_BASE_", TRUE, TRUE, FALSE);
7506
7507 if (tlsbase)
7508 {
7509 struct bfd_link_hash_entry *h = NULL;
7510 const struct elf_backend_data *bed =
7511 get_elf_backend_data (output_bfd);
7512
7513 if (!(_bfd_generic_link_add_one_symbol
7514 (info, output_bfd, "_TLS_MODULE_BASE_", BSF_LOCAL,
7515 tls_sec, 0, NULL, FALSE, bed->collect, &h)))
7516 return FALSE;
7517
7518 tlsbase->type = STT_TLS;
7519 tlsbase = (struct elf_link_hash_entry *) h;
7520 tlsbase->def_regular = 1;
7521 tlsbase->other = STV_HIDDEN;
7522 (*bed->elf_backend_hide_symbol) (info, tlsbase, TRUE);
7523 }
7524 }
7525
7526 return TRUE;
7527 }
7528
7529 /* Finish up dynamic symbol handling. We set the contents of various
7530 dynamic sections here. */
7531 static bfd_boolean
7532 elfNN_aarch64_finish_dynamic_symbol (bfd *output_bfd,
7533 struct bfd_link_info *info,
7534 struct elf_link_hash_entry *h,
7535 Elf_Internal_Sym *sym)
7536 {
7537 struct elf_aarch64_link_hash_table *htab;
7538 htab = elf_aarch64_hash_table (info);
7539
7540 if (h->plt.offset != (bfd_vma) - 1)
7541 {
7542 asection *plt, *gotplt, *relplt;
7543
7544 /* This symbol has an entry in the procedure linkage table. Set
7545 it up. */
7546
7547 /* When building a static executable, use .iplt, .igot.plt and
7548 .rela.iplt sections for STT_GNU_IFUNC symbols. */
7549 if (htab->root.splt != NULL)
7550 {
7551 plt = htab->root.splt;
7552 gotplt = htab->root.sgotplt;
7553 relplt = htab->root.srelplt;
7554 }
7555 else
7556 {
7557 plt = htab->root.iplt;
7558 gotplt = htab->root.igotplt;
7559 relplt = htab->root.irelplt;
7560 }
7561
7562 /* This symbol has an entry in the procedure linkage table. Set
7563 it up. */
7564 if ((h->dynindx == -1
7565 && !((h->forced_local || info->executable)
7566 && h->def_regular
7567 && h->type == STT_GNU_IFUNC))
7568 || plt == NULL
7569 || gotplt == NULL
7570 || relplt == NULL)
7571 abort ();
7572
7573 elfNN_aarch64_create_small_pltn_entry (h, htab, output_bfd, info);
7574 if (!h->def_regular)
7575 {
7576 /* Mark the symbol as undefined, rather than as defined in
7577 the .plt section. */
7578 sym->st_shndx = SHN_UNDEF;
7579 /* If the symbol is weak we need to clear the value.
7580 Otherwise, the PLT entry would provide a definition for
7581 the symbol even if the symbol wasn't defined anywhere,
7582 and so the symbol would never be NULL. Leave the value if
7583 there were any relocations where pointer equality matters
7584 (this is a clue for the dynamic linker, to make function
7585 pointer comparisons work between an application and shared
7586 library). */
7587 if (!h->ref_regular_nonweak || !h->pointer_equality_needed)
7588 sym->st_value = 0;
7589 }
7590 }
7591
7592 if (h->got.offset != (bfd_vma) - 1
7593 && elf_aarch64_hash_entry (h)->got_type == GOT_NORMAL)
7594 {
7595 Elf_Internal_Rela rela;
7596 bfd_byte *loc;
7597
7598 /* This symbol has an entry in the global offset table. Set it
7599 up. */
7600 if (htab->root.sgot == NULL || htab->root.srelgot == NULL)
7601 abort ();
7602
7603 rela.r_offset = (htab->root.sgot->output_section->vma
7604 + htab->root.sgot->output_offset
7605 + (h->got.offset & ~(bfd_vma) 1));
7606
7607 if (h->def_regular
7608 && h->type == STT_GNU_IFUNC)
7609 {
7610 if (info->shared)
7611 {
7612 /* Generate R_AARCH64_GLOB_DAT. */
7613 goto do_glob_dat;
7614 }
7615 else
7616 {
7617 asection *plt;
7618
7619 if (!h->pointer_equality_needed)
7620 abort ();
7621
7622 /* For non-shared object, we can't use .got.plt, which
7623 contains the real function address if we need pointer
7624 equality. We load the GOT entry with the PLT entry. */
7625 plt = htab->root.splt ? htab->root.splt : htab->root.iplt;
7626 bfd_put_NN (output_bfd, (plt->output_section->vma
7627 + plt->output_offset
7628 + h->plt.offset),
7629 htab->root.sgot->contents
7630 + (h->got.offset & ~(bfd_vma) 1));
7631 return TRUE;
7632 }
7633 }
7634 else if (info->shared && SYMBOL_REFERENCES_LOCAL (info, h))
7635 {
7636 if (!h->def_regular)
7637 return FALSE;
7638
7639 BFD_ASSERT ((h->got.offset & 1) != 0);
7640 rela.r_info = ELFNN_R_INFO (0, AARCH64_R (RELATIVE));
7641 rela.r_addend = (h->root.u.def.value
7642 + h->root.u.def.section->output_section->vma
7643 + h->root.u.def.section->output_offset);
7644 }
7645 else
7646 {
7647 do_glob_dat:
7648 BFD_ASSERT ((h->got.offset & 1) == 0);
7649 bfd_put_NN (output_bfd, (bfd_vma) 0,
7650 htab->root.sgot->contents + h->got.offset);
7651 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (GLOB_DAT));
7652 rela.r_addend = 0;
7653 }
7654
7655 loc = htab->root.srelgot->contents;
7656 loc += htab->root.srelgot->reloc_count++ * RELOC_SIZE (htab);
7657 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
7658 }
7659
7660 if (h->needs_copy)
7661 {
7662 Elf_Internal_Rela rela;
7663 bfd_byte *loc;
7664
7665 /* This symbol needs a copy reloc. Set it up. */
7666
7667 if (h->dynindx == -1
7668 || (h->root.type != bfd_link_hash_defined
7669 && h->root.type != bfd_link_hash_defweak)
7670 || htab->srelbss == NULL)
7671 abort ();
7672
7673 rela.r_offset = (h->root.u.def.value
7674 + h->root.u.def.section->output_section->vma
7675 + h->root.u.def.section->output_offset);
7676 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (COPY));
7677 rela.r_addend = 0;
7678 loc = htab->srelbss->contents;
7679 loc += htab->srelbss->reloc_count++ * RELOC_SIZE (htab);
7680 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
7681 }
7682
7683 /* Mark _DYNAMIC and _GLOBAL_OFFSET_TABLE_ as absolute. SYM may
7684 be NULL for local symbols. */
7685 if (sym != NULL
7686 && (h == elf_hash_table (info)->hdynamic
7687 || h == elf_hash_table (info)->hgot))
7688 sym->st_shndx = SHN_ABS;
7689
7690 return TRUE;
7691 }
7692
7693 /* Finish up local dynamic symbol handling. We set the contents of
7694 various dynamic sections here. */
7695
7696 static bfd_boolean
7697 elfNN_aarch64_finish_local_dynamic_symbol (void **slot, void *inf)
7698 {
7699 struct elf_link_hash_entry *h
7700 = (struct elf_link_hash_entry *) *slot;
7701 struct bfd_link_info *info
7702 = (struct bfd_link_info *) inf;
7703
7704 return elfNN_aarch64_finish_dynamic_symbol (info->output_bfd,
7705 info, h, NULL);
7706 }
7707
7708 static void
7709 elfNN_aarch64_init_small_plt0_entry (bfd *output_bfd ATTRIBUTE_UNUSED,
7710 struct elf_aarch64_link_hash_table
7711 *htab)
7712 {
7713 /* Fill in PLT0. Fixme:RR Note this doesn't distinguish between
7714 small and large plts and at the minute just generates
7715 the small PLT. */
7716
7717 /* PLT0 of the small PLT looks like this in ELF64 -
7718 stp x16, x30, [sp, #-16]! // Save the reloc and lr on stack.
7719 adrp x16, PLT_GOT + 16 // Get the page base of the GOTPLT
7720 ldr x17, [x16, #:lo12:PLT_GOT+16] // Load the address of the
7721 // symbol resolver
7722 add x16, x16, #:lo12:PLT_GOT+16 // Load the lo12 bits of the
7723 // GOTPLT entry for this.
7724 br x17
7725 PLT0 will be slightly different in ELF32 due to different got entry
7726 size.
7727 */
7728 bfd_vma plt_got_2nd_ent; /* Address of GOT[2]. */
7729 bfd_vma plt_base;
7730
7731
7732 memcpy (htab->root.splt->contents, elfNN_aarch64_small_plt0_entry,
7733 PLT_ENTRY_SIZE);
7734 elf_section_data (htab->root.splt->output_section)->this_hdr.sh_entsize =
7735 PLT_ENTRY_SIZE;
7736
7737 plt_got_2nd_ent = (htab->root.sgotplt->output_section->vma
7738 + htab->root.sgotplt->output_offset
7739 + GOT_ENTRY_SIZE * 2);
7740
7741 plt_base = htab->root.splt->output_section->vma +
7742 htab->root.splt->output_offset;
7743
7744 /* Fill in the top 21 bits for this: ADRP x16, PLT_GOT + n * 8.
7745 ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
7746 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADR_HI21_PCREL,
7747 htab->root.splt->contents + 4,
7748 PG (plt_got_2nd_ent) - PG (plt_base + 4));
7749
7750 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_LDSTNN_LO12,
7751 htab->root.splt->contents + 8,
7752 PG_OFFSET (plt_got_2nd_ent));
7753
7754 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADD_LO12,
7755 htab->root.splt->contents + 12,
7756 PG_OFFSET (plt_got_2nd_ent));
7757 }
7758
7759 static bfd_boolean
7760 elfNN_aarch64_finish_dynamic_sections (bfd *output_bfd,
7761 struct bfd_link_info *info)
7762 {
7763 struct elf_aarch64_link_hash_table *htab;
7764 bfd *dynobj;
7765 asection *sdyn;
7766
7767 htab = elf_aarch64_hash_table (info);
7768 dynobj = htab->root.dynobj;
7769 sdyn = bfd_get_linker_section (dynobj, ".dynamic");
7770
7771 if (htab->root.dynamic_sections_created)
7772 {
7773 ElfNN_External_Dyn *dyncon, *dynconend;
7774
7775 if (sdyn == NULL || htab->root.sgot == NULL)
7776 abort ();
7777
7778 dyncon = (ElfNN_External_Dyn *) sdyn->contents;
7779 dynconend = (ElfNN_External_Dyn *) (sdyn->contents + sdyn->size);
7780 for (; dyncon < dynconend; dyncon++)
7781 {
7782 Elf_Internal_Dyn dyn;
7783 asection *s;
7784
7785 bfd_elfNN_swap_dyn_in (dynobj, dyncon, &dyn);
7786
7787 switch (dyn.d_tag)
7788 {
7789 default:
7790 continue;
7791
7792 case DT_PLTGOT:
7793 s = htab->root.sgotplt;
7794 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset;
7795 break;
7796
7797 case DT_JMPREL:
7798 dyn.d_un.d_ptr = htab->root.srelplt->output_section->vma;
7799 break;
7800
7801 case DT_PLTRELSZ:
7802 s = htab->root.srelplt;
7803 dyn.d_un.d_val = s->size;
7804 break;
7805
7806 case DT_RELASZ:
7807 /* The procedure linkage table relocs (DT_JMPREL) should
7808 not be included in the overall relocs (DT_RELA).
7809 Therefore, we override the DT_RELASZ entry here to
7810 make it not include the JMPREL relocs. Since the
7811 linker script arranges for .rela.plt to follow all
7812 other relocation sections, we don't have to worry
7813 about changing the DT_RELA entry. */
7814 if (htab->root.srelplt != NULL)
7815 {
7816 s = htab->root.srelplt;
7817 dyn.d_un.d_val -= s->size;
7818 }
7819 break;
7820
7821 case DT_TLSDESC_PLT:
7822 s = htab->root.splt;
7823 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset
7824 + htab->tlsdesc_plt;
7825 break;
7826
7827 case DT_TLSDESC_GOT:
7828 s = htab->root.sgot;
7829 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset
7830 + htab->dt_tlsdesc_got;
7831 break;
7832 }
7833
7834 bfd_elfNN_swap_dyn_out (output_bfd, &dyn, dyncon);
7835 }
7836
7837 }
7838
7839 /* Fill in the special first entry in the procedure linkage table. */
7840 if (htab->root.splt && htab->root.splt->size > 0)
7841 {
7842 elfNN_aarch64_init_small_plt0_entry (output_bfd, htab);
7843
7844 elf_section_data (htab->root.splt->output_section)->
7845 this_hdr.sh_entsize = htab->plt_entry_size;
7846
7847
7848 if (htab->tlsdesc_plt)
7849 {
7850 bfd_put_NN (output_bfd, (bfd_vma) 0,
7851 htab->root.sgot->contents + htab->dt_tlsdesc_got);
7852
7853 memcpy (htab->root.splt->contents + htab->tlsdesc_plt,
7854 elfNN_aarch64_tlsdesc_small_plt_entry,
7855 sizeof (elfNN_aarch64_tlsdesc_small_plt_entry));
7856
7857 {
7858 bfd_vma adrp1_addr =
7859 htab->root.splt->output_section->vma
7860 + htab->root.splt->output_offset + htab->tlsdesc_plt + 4;
7861
7862 bfd_vma adrp2_addr = adrp1_addr + 4;
7863
7864 bfd_vma got_addr =
7865 htab->root.sgot->output_section->vma
7866 + htab->root.sgot->output_offset;
7867
7868 bfd_vma pltgot_addr =
7869 htab->root.sgotplt->output_section->vma
7870 + htab->root.sgotplt->output_offset;
7871
7872 bfd_vma dt_tlsdesc_got = got_addr + htab->dt_tlsdesc_got;
7873
7874 bfd_byte *plt_entry =
7875 htab->root.splt->contents + htab->tlsdesc_plt;
7876
7877 /* adrp x2, DT_TLSDESC_GOT */
7878 elf_aarch64_update_plt_entry (output_bfd,
7879 BFD_RELOC_AARCH64_ADR_HI21_PCREL,
7880 plt_entry + 4,
7881 (PG (dt_tlsdesc_got)
7882 - PG (adrp1_addr)));
7883
7884 /* adrp x3, 0 */
7885 elf_aarch64_update_plt_entry (output_bfd,
7886 BFD_RELOC_AARCH64_ADR_HI21_PCREL,
7887 plt_entry + 8,
7888 (PG (pltgot_addr)
7889 - PG (adrp2_addr)));
7890
7891 /* ldr x2, [x2, #0] */
7892 elf_aarch64_update_plt_entry (output_bfd,
7893 BFD_RELOC_AARCH64_LDSTNN_LO12,
7894 plt_entry + 12,
7895 PG_OFFSET (dt_tlsdesc_got));
7896
7897 /* add x3, x3, 0 */
7898 elf_aarch64_update_plt_entry (output_bfd,
7899 BFD_RELOC_AARCH64_ADD_LO12,
7900 plt_entry + 16,
7901 PG_OFFSET (pltgot_addr));
7902 }
7903 }
7904 }
7905
7906 if (htab->root.sgotplt)
7907 {
7908 if (bfd_is_abs_section (htab->root.sgotplt->output_section))
7909 {
7910 (*_bfd_error_handler)
7911 (_("discarded output section: `%A'"), htab->root.sgotplt);
7912 return FALSE;
7913 }
7914
7915 /* Fill in the first three entries in the global offset table. */
7916 if (htab->root.sgotplt->size > 0)
7917 {
7918 bfd_put_NN (output_bfd, (bfd_vma) 0, htab->root.sgotplt->contents);
7919
7920 /* Write GOT[1] and GOT[2], needed for the dynamic linker. */
7921 bfd_put_NN (output_bfd,
7922 (bfd_vma) 0,
7923 htab->root.sgotplt->contents + GOT_ENTRY_SIZE);
7924 bfd_put_NN (output_bfd,
7925 (bfd_vma) 0,
7926 htab->root.sgotplt->contents + GOT_ENTRY_SIZE * 2);
7927 }
7928
7929 if (htab->root.sgot)
7930 {
7931 if (htab->root.sgot->size > 0)
7932 {
7933 bfd_vma addr =
7934 sdyn ? sdyn->output_section->vma + sdyn->output_offset : 0;
7935 bfd_put_NN (output_bfd, addr, htab->root.sgot->contents);
7936 }
7937 }
7938
7939 elf_section_data (htab->root.sgotplt->output_section)->
7940 this_hdr.sh_entsize = GOT_ENTRY_SIZE;
7941 }
7942
7943 if (htab->root.sgot && htab->root.sgot->size > 0)
7944 elf_section_data (htab->root.sgot->output_section)->this_hdr.sh_entsize
7945 = GOT_ENTRY_SIZE;
7946
7947 /* Fill PLT and GOT entries for local STT_GNU_IFUNC symbols. */
7948 htab_traverse (htab->loc_hash_table,
7949 elfNN_aarch64_finish_local_dynamic_symbol,
7950 info);
7951
7952 return TRUE;
7953 }
7954
7955 /* Return address for Ith PLT stub in section PLT, for relocation REL
7956 or (bfd_vma) -1 if it should not be included. */
7957
7958 static bfd_vma
7959 elfNN_aarch64_plt_sym_val (bfd_vma i, const asection *plt,
7960 const arelent *rel ATTRIBUTE_UNUSED)
7961 {
7962 return plt->vma + PLT_ENTRY_SIZE + i * PLT_SMALL_ENTRY_SIZE;
7963 }
7964
7965
7966 /* We use this so we can override certain functions
7967 (though currently we don't). */
7968
7969 const struct elf_size_info elfNN_aarch64_size_info =
7970 {
7971 sizeof (ElfNN_External_Ehdr),
7972 sizeof (ElfNN_External_Phdr),
7973 sizeof (ElfNN_External_Shdr),
7974 sizeof (ElfNN_External_Rel),
7975 sizeof (ElfNN_External_Rela),
7976 sizeof (ElfNN_External_Sym),
7977 sizeof (ElfNN_External_Dyn),
7978 sizeof (Elf_External_Note),
7979 4, /* Hash table entry size. */
7980 1, /* Internal relocs per external relocs. */
7981 ARCH_SIZE, /* Arch size. */
7982 LOG_FILE_ALIGN, /* Log_file_align. */
7983 ELFCLASSNN, EV_CURRENT,
7984 bfd_elfNN_write_out_phdrs,
7985 bfd_elfNN_write_shdrs_and_ehdr,
7986 bfd_elfNN_checksum_contents,
7987 bfd_elfNN_write_relocs,
7988 bfd_elfNN_swap_symbol_in,
7989 bfd_elfNN_swap_symbol_out,
7990 bfd_elfNN_slurp_reloc_table,
7991 bfd_elfNN_slurp_symbol_table,
7992 bfd_elfNN_swap_dyn_in,
7993 bfd_elfNN_swap_dyn_out,
7994 bfd_elfNN_swap_reloc_in,
7995 bfd_elfNN_swap_reloc_out,
7996 bfd_elfNN_swap_reloca_in,
7997 bfd_elfNN_swap_reloca_out
7998 };
7999
8000 #define ELF_ARCH bfd_arch_aarch64
8001 #define ELF_MACHINE_CODE EM_AARCH64
8002 #define ELF_MAXPAGESIZE 0x10000
8003 #define ELF_MINPAGESIZE 0x1000
8004 #define ELF_COMMONPAGESIZE 0x1000
8005
8006 #define bfd_elfNN_close_and_cleanup \
8007 elfNN_aarch64_close_and_cleanup
8008
8009 #define bfd_elfNN_bfd_free_cached_info \
8010 elfNN_aarch64_bfd_free_cached_info
8011
8012 #define bfd_elfNN_bfd_is_target_special_symbol \
8013 elfNN_aarch64_is_target_special_symbol
8014
8015 #define bfd_elfNN_bfd_link_hash_table_create \
8016 elfNN_aarch64_link_hash_table_create
8017
8018 #define bfd_elfNN_bfd_merge_private_bfd_data \
8019 elfNN_aarch64_merge_private_bfd_data
8020
8021 #define bfd_elfNN_bfd_print_private_bfd_data \
8022 elfNN_aarch64_print_private_bfd_data
8023
8024 #define bfd_elfNN_bfd_reloc_type_lookup \
8025 elfNN_aarch64_reloc_type_lookup
8026
8027 #define bfd_elfNN_bfd_reloc_name_lookup \
8028 elfNN_aarch64_reloc_name_lookup
8029
8030 #define bfd_elfNN_bfd_set_private_flags \
8031 elfNN_aarch64_set_private_flags
8032
8033 #define bfd_elfNN_find_inliner_info \
8034 elfNN_aarch64_find_inliner_info
8035
8036 #define bfd_elfNN_find_nearest_line \
8037 elfNN_aarch64_find_nearest_line
8038
8039 #define bfd_elfNN_mkobject \
8040 elfNN_aarch64_mkobject
8041
8042 #define bfd_elfNN_new_section_hook \
8043 elfNN_aarch64_new_section_hook
8044
8045 #define elf_backend_adjust_dynamic_symbol \
8046 elfNN_aarch64_adjust_dynamic_symbol
8047
8048 #define elf_backend_always_size_sections \
8049 elfNN_aarch64_always_size_sections
8050
8051 #define elf_backend_check_relocs \
8052 elfNN_aarch64_check_relocs
8053
8054 #define elf_backend_copy_indirect_symbol \
8055 elfNN_aarch64_copy_indirect_symbol
8056
8057 /* Create .dynbss, and .rela.bss sections in DYNOBJ, and set up shortcuts
8058 to them in our hash. */
8059 #define elf_backend_create_dynamic_sections \
8060 elfNN_aarch64_create_dynamic_sections
8061
8062 #define elf_backend_init_index_section \
8063 _bfd_elf_init_2_index_sections
8064
8065 #define elf_backend_finish_dynamic_sections \
8066 elfNN_aarch64_finish_dynamic_sections
8067
8068 #define elf_backend_finish_dynamic_symbol \
8069 elfNN_aarch64_finish_dynamic_symbol
8070
8071 #define elf_backend_gc_sweep_hook \
8072 elfNN_aarch64_gc_sweep_hook
8073
8074 #define elf_backend_object_p \
8075 elfNN_aarch64_object_p
8076
8077 #define elf_backend_output_arch_local_syms \
8078 elfNN_aarch64_output_arch_local_syms
8079
8080 #define elf_backend_plt_sym_val \
8081 elfNN_aarch64_plt_sym_val
8082
8083 #define elf_backend_post_process_headers \
8084 elfNN_aarch64_post_process_headers
8085
8086 #define elf_backend_relocate_section \
8087 elfNN_aarch64_relocate_section
8088
8089 #define elf_backend_reloc_type_class \
8090 elfNN_aarch64_reloc_type_class
8091
8092 #define elf_backend_section_from_shdr \
8093 elfNN_aarch64_section_from_shdr
8094
8095 #define elf_backend_size_dynamic_sections \
8096 elfNN_aarch64_size_dynamic_sections
8097
8098 #define elf_backend_size_info \
8099 elfNN_aarch64_size_info
8100
8101 #define elf_backend_write_section \
8102 elfNN_aarch64_write_section
8103
8104 #define elf_backend_can_refcount 1
8105 #define elf_backend_can_gc_sections 1
8106 #define elf_backend_plt_readonly 1
8107 #define elf_backend_want_got_plt 1
8108 #define elf_backend_want_plt_sym 0
8109 #define elf_backend_may_use_rel_p 0
8110 #define elf_backend_may_use_rela_p 1
8111 #define elf_backend_default_use_rela_p 1
8112 #define elf_backend_rela_normal 1
8113 #define elf_backend_got_header_size (GOT_ENTRY_SIZE * 3)
8114 #define elf_backend_default_execstack 0
8115
8116 #undef elf_backend_obj_attrs_section
8117 #define elf_backend_obj_attrs_section ".ARM.attributes"
8118
8119 #include "elfNN-target.h"
GDB Binutils - Deliverables
This page took 0.219087 seconds and 4 git commands to generate.