Blame SOURCES/0549-modules-load-module-sections-at-page-aligned-address.patch

0ccc47
From 0000000000000000000000000000000000000000 Mon Sep 17 00:00:00 2001
0ccc47
From: Peter Jones <pjones@redhat.com>
0ccc47
Date: Mon, 21 Mar 2022 17:45:40 -0400
0ccc47
Subject: [PATCH] modules: load module sections at page-aligned addresses
0ccc47
0ccc47
Currently we load module sections at whatever alignment gcc+ld happened
0ccc47
to dump into the ELF section header, which is often pretty useless.  For
0ccc47
example, by default time.mod has these sections on a current x86_64
0ccc47
build:
0ccc47
0ccc47
$ eu-readelf -a grub-core/time.mod |& grep ^Section -A13
0ccc47
Section Headers:
0ccc47
[Nr] Name            Type         Addr  Off      Size     ES Flags Lk Inf Al
0ccc47
[ 0]                 NULL         0     00000000 00000000  0        0   0  0
0ccc47
[ 1] .text           PROGBITS     0     00000040 0000015e  0 AX     0   0  1
0ccc47
[ 2] .rela.text      RELA         0     00000458 000001e0 24 I      8   1  8
0ccc47
[ 3] .rodata.str1.1  PROGBITS     0     0000019e 000000a1  1 AMS    0   0  1
0ccc47
[ 4] .module_license PROGBITS     0     00000240 0000000f  0 A      0   0  8
0ccc47
[ 5] .data           PROGBITS     0     0000024f 00000000  0 WA     0   0  1
0ccc47
[ 6] .bss            NOBITS       0     00000250 00000008  0 WA     0   0  8
0ccc47
[ 7] .modname        PROGBITS     0     00000250 00000005  0        0   0  1
0ccc47
[ 8] .symtab         SYMTAB       0     00000258 00000150 24        9   6  8
0ccc47
[ 9] .strtab         STRTAB       0     000003a8 000000ab  0        0   0  1
0ccc47
[10] .shstrtab       STRTAB       0     00000638 00000059  0        0   0  1
0ccc47
0ccc47
With NX protections being page based, loading sections with either a 1
0ccc47
or 8 *byte* alignment does absolutely nothing to help us out.
0ccc47
0ccc47
This patch switches most EFI platforms to load module sections at 4kB
0ccc47
page-aligned addresses.  To do so, it adds an new per-arch function,
0ccc47
grub_arch_dl_min_alignment(), which returns the alignment needed for
0ccc47
dynamically loaded sections (in bytes).  Currently it sets it to 4096
0ccc47
when GRUB_MACHINE_EFI is true on x86_64, i386, arm, arm64, and emu, and
0ccc47
1-byte alignment on everything else.
0ccc47
0ccc47
It then changes the allocation size computation and the loader code in
0ccc47
grub_dl_load_segments() to align the locations and sizes up to these
0ccc47
boundaries, and fills any added padding with zeros.
0ccc47
0ccc47
All of this happens before relocations are applied, so the relocations
0ccc47
factor that in with no change.
0ccc47
0ccc47
As an aside, initially Daniel Kiper and I thought that it might be a
0ccc47
better idea to split the modules up into top-level sections as
0ccc47
.text.modules, .rodata.modules, .data.modules, etc., so that their page
0ccc47
permissions would get set by the loader that's loading grub itself.
0ccc47
This turns out to have two significant downsides: 1) either in mkimage
0ccc47
or in grub_dl_relocate_symbols(), you wind up having to dynamically
0ccc47
process the relocations to accommodate the moved module sections, and 2)
0ccc47
you then need to change the permissions on the modules and change them
0ccc47
back while relocating them in grub_dl_relocate_symbols(), which means
0ccc47
that any loader that /does/ honor the section flags but does /not/
0ccc47
generally support NX with the memory attributes API will cause grub to
0ccc47
fail.
0ccc47
0ccc47
Signed-off-by: Peter Jones <pjones@redhat.com>
0ccc47
(cherry picked from commit 31d52500b281619d92b03b2c2d30fe15aedaf326)
0ccc47
(cherry picked from commit 04f1df6b665493e38de66018aebe377fdac4ceec)
0ccc47
[rharwood: not risc-v yet]
0ccc47
Signed-off-by: Robbie Harwood <rharwood@redhat.com>
0ccc47
---
0ccc47
 grub-core/kern/arm/dl.c     | 13 +++++++++++++
0ccc47
 grub-core/kern/arm64/dl.c   | 13 +++++++++++++
0ccc47
 grub-core/kern/dl.c         | 29 +++++++++++++++++++++--------
0ccc47
 grub-core/kern/emu/full.c   | 13 +++++++++++++
0ccc47
 grub-core/kern/i386/dl.c    | 13 +++++++++++++
0ccc47
 grub-core/kern/ia64/dl.c    |  9 +++++++++
0ccc47
 grub-core/kern/mips/dl.c    |  8 ++++++++
0ccc47
 grub-core/kern/powerpc/dl.c |  9 +++++++++
0ccc47
 grub-core/kern/sparc64/dl.c |  9 +++++++++
0ccc47
 grub-core/kern/x86_64/dl.c  | 13 +++++++++++++
0ccc47
 include/grub/dl.h           |  2 ++
0ccc47
 docs/grub-dev.texi          |  6 +++---
0ccc47
 12 files changed, 126 insertions(+), 11 deletions(-)
0ccc47
0ccc47
diff --git a/grub-core/kern/arm/dl.c b/grub-core/kern/arm/dl.c
0ccc47
index eab9d17ff2..9260737936 100644
0ccc47
--- a/grub-core/kern/arm/dl.c
0ccc47
+++ b/grub-core/kern/arm/dl.c
0ccc47
@@ -278,3 +278,16 @@ grub_arch_dl_check_header (void *ehdr)
0ccc47
 
0ccc47
   return GRUB_ERR_NONE;
0ccc47
 }
0ccc47
+
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+#ifdef GRUB_MACHINE_EFI
0ccc47
+  return 4096;
0ccc47
+#else
0ccc47
+  return 1;
0ccc47
+#endif
0ccc47
+}
0ccc47
diff --git a/grub-core/kern/arm64/dl.c b/grub-core/kern/arm64/dl.c
0ccc47
index fb03373190..826f8e721e 100644
0ccc47
--- a/grub-core/kern/arm64/dl.c
0ccc47
+++ b/grub-core/kern/arm64/dl.c
0ccc47
@@ -191,3 +191,16 @@ grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr,
0ccc47
 
0ccc47
   return GRUB_ERR_NONE;
0ccc47
 }
0ccc47
+
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+#ifdef GRUB_MACHINE_EFI
0ccc47
+  return 4096;
0ccc47
+#else
0ccc47
+  return 1;
0ccc47
+#endif
0ccc47
+}
0ccc47
diff --git a/grub-core/kern/dl.c b/grub-core/kern/dl.c
0ccc47
index ba1b33c20b..5c2153acf9 100644
0ccc47
--- a/grub-core/kern/dl.c
0ccc47
+++ b/grub-core/kern/dl.c
0ccc47
@@ -278,7 +278,7 @@ grub_dl_load_segments (grub_dl_t mod, const Elf_Ehdr *e)
0ccc47
 {
0ccc47
   unsigned i;
0ccc47
   const Elf_Shdr *s;
0ccc47
-  grub_size_t tsize = 0, talign = 1;
0ccc47
+  grub_size_t tsize = 0, talign = 1, arch_addralign = 1;
0ccc47
 #if !defined (__i386__) && !defined (__x86_64__)
0ccc47
   grub_size_t tramp;
0ccc47
   grub_size_t got;
0ccc47
@@ -286,16 +286,24 @@ grub_dl_load_segments (grub_dl_t mod, const Elf_Ehdr *e)
0ccc47
 #endif
0ccc47
   char *ptr;
0ccc47
 
0ccc47
+  arch_addralign = grub_arch_dl_min_alignment ();
0ccc47
+
0ccc47
   for (i = 0, s = (const Elf_Shdr *)((const char *) e + e->e_shoff);
0ccc47
        i < e->e_shnum;
0ccc47
        i++, s = (const Elf_Shdr *)((const char *) s + e->e_shentsize))
0ccc47
     {
0ccc47
+      grub_size_t sh_addralign;
0ccc47
+      grub_size_t sh_size;
0ccc47
+
0ccc47
       if (s->sh_size == 0 || !(s->sh_flags & SHF_ALLOC))
0ccc47
 	continue;
0ccc47
 
0ccc47
-      tsize = ALIGN_UP (tsize, s->sh_addralign) + s->sh_size;
0ccc47
-      if (talign < s->sh_addralign)
0ccc47
-	talign = s->sh_addralign;
0ccc47
+      sh_addralign = ALIGN_UP(s->sh_addralign, arch_addralign);
0ccc47
+      sh_size = ALIGN_UP(s->sh_size, sh_addralign);
0ccc47
+
0ccc47
+      tsize = ALIGN_UP (tsize, sh_addralign) + sh_size;
0ccc47
+      if (talign < sh_addralign)
0ccc47
+	talign = sh_addralign;
0ccc47
     }
0ccc47
 
0ccc47
 #if !defined (__i386__) && !defined (__x86_64__)
0ccc47
@@ -324,6 +332,9 @@ grub_dl_load_segments (grub_dl_t mod, const Elf_Ehdr *e)
0ccc47
        i < e->e_shnum;
0ccc47
        i++, s = (Elf_Shdr *)((char *) s + e->e_shentsize))
0ccc47
     {
0ccc47
+      grub_size_t sh_addralign = ALIGN_UP(s->sh_addralign, arch_addralign);
0ccc47
+      grub_size_t sh_size = ALIGN_UP(s->sh_size, sh_addralign);
0ccc47
+
0ccc47
       if (s->sh_flags & SHF_ALLOC)
0ccc47
 	{
0ccc47
 	  grub_dl_segment_t seg;
0ccc47
@@ -336,17 +347,19 @@ grub_dl_load_segments (grub_dl_t mod, const Elf_Ehdr *e)
0ccc47
 	    {
0ccc47
 	      void *addr;
0ccc47
 
0ccc47
-	      ptr = (char *) ALIGN_UP ((grub_addr_t) ptr, s->sh_addralign);
0ccc47
+	      ptr = (char *) ALIGN_UP ((grub_addr_t) ptr, sh_addralign);
0ccc47
 	      addr = ptr;
0ccc47
-	      ptr += s->sh_size;
0ccc47
+	      ptr += sh_size;
0ccc47
 
0ccc47
 	      switch (s->sh_type)
0ccc47
 		{
0ccc47
 		case SHT_PROGBITS:
0ccc47
 		  grub_memcpy (addr, (char *) e + s->sh_offset, s->sh_size);
0ccc47
+		  grub_memset ((char *)addr + s->sh_size, 0,
0ccc47
+			       sh_size - s->sh_size);
0ccc47
 		  break;
0ccc47
 		case SHT_NOBITS:
0ccc47
-		  grub_memset (addr, 0, s->sh_size);
0ccc47
+		  grub_memset (addr, 0, sh_size);
0ccc47
 		  break;
0ccc47
 		}
0ccc47
 
0ccc47
@@ -355,7 +368,7 @@ grub_dl_load_segments (grub_dl_t mod, const Elf_Ehdr *e)
0ccc47
 	  else
0ccc47
 	    seg->addr = 0;
0ccc47
 
0ccc47
-	  seg->size = s->sh_size;
0ccc47
+	  seg->size = sh_size;
0ccc47
 	  seg->section = i;
0ccc47
 	  seg->next = mod->segment;
0ccc47
 	  mod->segment = seg;
0ccc47
diff --git a/grub-core/kern/emu/full.c b/grub-core/kern/emu/full.c
0ccc47
index e8d63b1f5f..1de1c28eb0 100644
0ccc47
--- a/grub-core/kern/emu/full.c
0ccc47
+++ b/grub-core/kern/emu/full.c
0ccc47
@@ -67,3 +67,16 @@ grub_arch_dl_init_linker (void)
0ccc47
 }
0ccc47
 #endif
0ccc47
 
0ccc47
+
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+#ifdef GRUB_MACHINE_EFI
0ccc47
+  return 4096;
0ccc47
+#else
0ccc47
+  return 1;
0ccc47
+#endif
0ccc47
+}
0ccc47
diff --git a/grub-core/kern/i386/dl.c b/grub-core/kern/i386/dl.c
0ccc47
index 1346da5cc9..d6b4681fc9 100644
0ccc47
--- a/grub-core/kern/i386/dl.c
0ccc47
+++ b/grub-core/kern/i386/dl.c
0ccc47
@@ -79,3 +79,16 @@ grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr,
0ccc47
 
0ccc47
   return GRUB_ERR_NONE;
0ccc47
 }
0ccc47
+
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+#ifdef GRUB_MACHINE_EFI
0ccc47
+  return 4096;
0ccc47
+#else
0ccc47
+  return 1;
0ccc47
+#endif
0ccc47
+}
0ccc47
diff --git a/grub-core/kern/ia64/dl.c b/grub-core/kern/ia64/dl.c
0ccc47
index ebcf316298..3bb753a89b 100644
0ccc47
--- a/grub-core/kern/ia64/dl.c
0ccc47
+++ b/grub-core/kern/ia64/dl.c
0ccc47
@@ -143,3 +143,12 @@ grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr,
0ccc47
     }
0ccc47
   return GRUB_ERR_NONE;
0ccc47
 }
0ccc47
+
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+  return 1;
0ccc47
+}
0ccc47
diff --git a/grub-core/kern/mips/dl.c b/grub-core/kern/mips/dl.c
0ccc47
index 5d7d299c74..6d83bd71e9 100644
0ccc47
--- a/grub-core/kern/mips/dl.c
0ccc47
+++ b/grub-core/kern/mips/dl.c
0ccc47
@@ -272,3 +272,11 @@ grub_arch_dl_init_linker (void)
0ccc47
   grub_dl_register_symbol ("_gp_disp", &_gp_disp_dummy, 0, 0);
0ccc47
 }
0ccc47
 
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+  return 1;
0ccc47
+}
0ccc47
diff --git a/grub-core/kern/powerpc/dl.c b/grub-core/kern/powerpc/dl.c
0ccc47
index 3a7fa3ed3d..577e27d871 100644
0ccc47
--- a/grub-core/kern/powerpc/dl.c
0ccc47
+++ b/grub-core/kern/powerpc/dl.c
0ccc47
@@ -165,3 +165,12 @@ grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr,
0ccc47
 
0ccc47
   return GRUB_ERR_NONE;
0ccc47
 }
0ccc47
+
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+  return 1;
0ccc47
+}
0ccc47
diff --git a/grub-core/kern/sparc64/dl.c b/grub-core/kern/sparc64/dl.c
0ccc47
index 739be47174..c741c1782e 100644
0ccc47
--- a/grub-core/kern/sparc64/dl.c
0ccc47
+++ b/grub-core/kern/sparc64/dl.c
0ccc47
@@ -184,3 +184,12 @@ grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr,
0ccc47
 
0ccc47
   return GRUB_ERR_NONE;
0ccc47
 }
0ccc47
+
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+  return 1;
0ccc47
+}
0ccc47
diff --git a/grub-core/kern/x86_64/dl.c b/grub-core/kern/x86_64/dl.c
0ccc47
index 3a73e6e6ce..6c20b7c367 100644
0ccc47
--- a/grub-core/kern/x86_64/dl.c
0ccc47
+++ b/grub-core/kern/x86_64/dl.c
0ccc47
@@ -114,3 +114,16 @@ grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr,
0ccc47
 
0ccc47
   return GRUB_ERR_NONE;
0ccc47
 }
0ccc47
+
0ccc47
+/*
0ccc47
+ * Tell the loader what our minimum section alignment is.
0ccc47
+ */
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void)
0ccc47
+{
0ccc47
+#ifdef GRUB_MACHINE_EFI
0ccc47
+  return 4096;
0ccc47
+#else
0ccc47
+  return 1;
0ccc47
+#endif
0ccc47
+}
0ccc47
diff --git a/include/grub/dl.h b/include/grub/dl.h
0ccc47
index 9ec6caf3f9..dd4c3e7ff4 100644
0ccc47
--- a/include/grub/dl.h
0ccc47
+++ b/include/grub/dl.h
0ccc47
@@ -280,6 +280,8 @@ grub_err_t grub_arch_dl_check_header (void *ehdr);
0ccc47
 grub_err_t
0ccc47
 grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr,
0ccc47
 			       Elf_Shdr *s, grub_dl_segment_t seg);
0ccc47
+grub_size_t
0ccc47
+grub_arch_dl_min_alignment (void);
0ccc47
 #endif
0ccc47
 
0ccc47
 #if defined (_mips)
0ccc47
diff --git a/docs/grub-dev.texi b/docs/grub-dev.texi
0ccc47
index 03d53498c5..dbfb94bc06 100644
0ccc47
--- a/docs/grub-dev.texi
0ccc47
+++ b/docs/grub-dev.texi
0ccc47
@@ -638,9 +638,9 @@ declare startup asm file ($cpu_$platform_startup) as well as any other files
0ccc47
 (e.g. init.c and callwrap.S) (e.g. $cpu_$platform = kern/$cpu/$platform/init.c).
0ccc47
 At this stage you will also need to add dummy dl.c and cache.S with functions
0ccc47
 grub_err_t grub_arch_dl_check_header (void *ehdr), grub_err_t
0ccc47
-grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr) (dl.c) and
0ccc47
-void grub_arch_sync_caches (void *address, grub_size_t len) (cache.S). They
0ccc47
-won't be used for now.
0ccc47
+grub_arch_dl_relocate_symbols (grub_dl_t mod, void *ehdr) (dl.c), grub_uint32_t
0ccc47
+grub_arch_dl_min_alignment (void), and void grub_arch_sync_caches (void
0ccc47
+*address, grub_size_t len) (cache.S). They won't be used for now.
0ccc47
 
0ccc47
 You will need to create directory include/$cpu/$platform and a file
0ccc47
 include/$cpu/types.h. The later folowing this template: