mirror of
https://github.com/deepfakes/faceswap
synced 2025-06-07 10:43:27 -04:00
* model_refactor (#571) * original model to new structure * IAE model to new structure * OriginalHiRes to new structure * Fix trainer for different resolutions * Initial config implementation * Configparse library added * improved training data loader * dfaker model working * Add logging to training functions * Non blocking input for cli training * Add error handling to threads. Add non-mp queues to queue_handler * Improved Model Building and NNMeta * refactor lib/models * training refactor. DFL H128 model Implementation * Dfaker - use hashes * Move timelapse. Remove perceptual loss arg * Update INSTALL.md. Add logger formatting. Update Dfaker training * DFL h128 partially ported * Add mask to dfaker (#573) * Remove old models. Add mask to dfaker * dfl mask. Make masks selectable in config (#575) * DFL H128 Mask. Mask type selectable in config. * remove gan_v2_2 * Creating Input Size config for models Creating Input Size config for models Will be used downstream in converters. Also name change of image_shape to input_shape to clarify ( for future models with potentially different output_shapes) * Add mask loss options to config * MTCNN options to config.ini. Remove GAN config. Update USAGE.md * Add sliders for numerical values in GUI * Add config plugins menu to gui. Validate config * Only backup model if loss has dropped. Get training working again * bugfixes * Standardise loss printing * GUI idle cpu fixes. Graph loss fix. * mutli-gpu logging bugfix * Merge branch 'staging' into train_refactor * backup state file * Crash protection: Only backup if both total losses have dropped * Port OriginalHiRes_RC4 to train_refactor (OriginalHiRes) * Load and save model structure with weights * Slight code update * Improve config loader. Add subpixel opt to all models. Config to state * Show samples... wrong input * Remove AE topology. Add input/output shapes to State * Port original_villain (birb/VillainGuy) model to faceswap * Add plugin info to GUI config pages * Load input shape from state. IAE Config options. * Fix transform_kwargs. Coverage to ratio. Bugfix mask detection * Suppress keras userwarnings. Automate zoom. Coverage_ratio to model def. * Consolidation of converters & refactor (#574) * Consolidation of converters & refactor Initial Upload of alpha Items - consolidate convert_mased & convert_adjust into one converter -add average color adjust to convert_masked -allow mask transition blur size to be a fixed integer of pixels and a fraction of the facial mask size -allow erosion/dilation size to be a fixed integer of pixels and a fraction of the facial mask size -eliminate redundant type conversions to avoid multiple round-off errors -refactor loops for vectorization/speed -reorganize for clarity & style changes TODO - bug/issues with warping the new face onto a transparent old image...use a cleanup mask for now - issues with mask border giving black ring at zero erosion .. investigate - remove GAN ?? - test enlargment factors of umeyama standard face .. match to coverage factor - make enlargment factor a model parameter - remove convert_adjusted and referencing code when finished * Update Convert_Masked.py default blur size of 2 to match original... description of enlargement tests breakout matrxi scaling into def * Enlargment scale as a cli parameter * Update cli.py * dynamic interpolation algorithm Compute x & y scale factors from the affine matrix on the fly by QR decomp. Choose interpolation alogrithm for the affine warp based on an upsample or downsample for each image * input size input size from config * fix issues with <1.0 erosion * Update convert.py * Update Convert_Adjust.py more work on the way to merginf * Clean up help note on sharpen * cleanup seamless * Delete Convert_Adjust.py * Update umeyama.py * Update training_data.py * swapping * segmentation stub * changes to convert.str * Update masked.py * Backwards compatibility fix for models Get converter running * Convert: Move masks to class. bugfix blur_size some linting * mask fix * convert fixes - missing facehull_rect re-added - coverage to % - corrected coverage logic - cleanup of gui option ordering * Update cli.py * default for blur * Update masked.py * added preliminary low_mem version of OriginalHighRes model plugin * Code cleanup, minor fixes * Update masked.py * Update masked.py * Add dfl mask to convert * histogram fix & seamless location * update * revert * bugfix: Load actual configuration in gui * Standardize nn_blocks * Update cli.py * Minor code amends * Fix Original HiRes model * Add masks to preview output for mask trainers refactor trainer.__base.py * Masked trainers converter support * convert bugfix * Bugfix: Converter for masked (dfl/dfaker) trainers * Additional Losses (#592) * initial upload * Delete blur.py * default initializer = He instead of Glorot (#588) * Allow kernel_initializer to be overridable * Add ICNR Initializer option for upscale on all models. * Hopefully fixes RSoDs with original-highres model plugin * remove debug line * Original-HighRes model plugin Red Screen of Death fix, take #2 * Move global options to _base. Rename Villain model * clipnorm and res block biases * scale the end of res block * res block * dfaker pre-activation res * OHRES pre-activation * villain pre-activation * tabs/space in nn_blocks * fix for histogram with mask all set to zero * fix to prevent two networks with same name * GUI: Wider tooltips. Improve TQDM capture * Fix regex bug * Convert padding=48 to ratio of image size * Add size option to alignments tool extract * Pass through training image size to convert from model * Convert: Pull training coverage from model * convert: coverage, blur and erode to percent * simplify matrix scaling * ordering of sliders in train * Add matrix scaling to utils. Use interpolation in lib.aligner transform * masked.py Import get_matrix_scaling from utils * fix circular import * Update masked.py * quick fix for matrix scaling * testing thus for now * tqdm regex capture bugfix * Minor ammends * blur size cleanup * Remove coverage option from convert (Now cascades from model) * Implement convert for all model types * Add mask option and coverage option to all existing models * bugfix for model loading on convert * debug print removal * Bugfix for masks in dfl_h128 and iae * Update preview display. Add preview scaling to cli * mask notes * Delete training_data_v2.py errant file * training data variables * Fix timelapse function * Add new config items to state file for legacy purposes * Slight GUI tweak * Raise exception if problem with loaded model * Add Tensorboard support (Logs stored in model directory) * ICNR fix * loss bugfix * convert bugfix * Move ini files to config folder. Make TensorBoard optional * Fix training data for unbalanced inputs/outputs * Fix config "none" test * Keep helptext in .ini files when saving config from GUI * Remove frame_dims from alignments * Add no-flip and warp-to-landmarks cli options * Revert OHR to RC4_fix version * Fix lowmem mode on OHR model * padding to variable * Save models in parallel threads * Speed-up of res_block stability * Automated Reflection Padding * Reflect Padding as a training option Includes auto-calculation of proper padding shapes, input_shapes, output_shapes Flag included in config now * rest of reflect padding * Move TB logging to cli. Session info to state file * Add session iterations to state file * Add recent files to menu. GUI code tidy up * [GUI] Fix recent file list update issue * Add correct loss names to TensorBoard logs * Update live graph to use TensorBoard and remove animation * Fix analysis tab. GUI optimizations * Analysis Graph popup to Tensorboard Logs * [GUI] Bug fix for graphing for models with hypens in name * [GUI] Correctly split loss to tabs during training * [GUI] Add loss type selection to analysis graph * Fix store command name in recent files. Switch to correct tab on open * [GUI] Disable training graph when 'no-logs' is selected * Fix graphing race condition * rename original_hires model to unbalanced
262 lines
9.1 KiB
Python
262 lines
9.1 KiB
Python
#!/usr/bin python3
|
|
""" Display Page parent classes for display section of the Faceswap GUI """
|
|
|
|
import logging
|
|
import tkinter as tk
|
|
from tkinter import ttk
|
|
|
|
from .tooltip import Tooltip
|
|
from .utils import get_images
|
|
|
|
logger = logging.getLogger(__name__) # pylint: disable=invalid-name
|
|
|
|
|
|
class DisplayPage(ttk.Frame):
|
|
""" Parent frame holder for each tab.
|
|
Defines uniform structure for each tab to inherit from """
|
|
def __init__(self, parent, tabname, helptext):
|
|
logger.debug("Initializing %s: (tabname: '%s', helptext: %s",
|
|
self.__class__.__name__, tabname, helptext)
|
|
ttk.Frame.__init__(self, parent)
|
|
self.pack(fill=tk.BOTH, side=tk.TOP, anchor=tk.NW)
|
|
|
|
self.runningtask = parent.runningtask
|
|
self.helptext = helptext
|
|
self.tabname = tabname
|
|
|
|
self.vars = {"info": tk.StringVar()}
|
|
self.add_optional_vars(self.set_vars())
|
|
|
|
self.subnotebook = self.add_subnotebook()
|
|
self.optsframe = self.add_options_frame()
|
|
self.add_options_info()
|
|
|
|
self.add_frame_separator()
|
|
self.set_mainframe_single_tab_style()
|
|
parent.add(self, text=self.tabname.title())
|
|
logger.debug("Initialized %s", self.__class__.__name__,)
|
|
|
|
def add_optional_vars(self, varsdict):
|
|
""" Add page specific variables """
|
|
if isinstance(varsdict, dict):
|
|
for key, val in varsdict.items():
|
|
logger.debug("Adding: (%s: %s)", key, val)
|
|
self.vars[key] = val
|
|
|
|
@staticmethod
|
|
def set_vars():
|
|
""" Override to return a dict of page specific variables """
|
|
return dict()
|
|
|
|
def add_subnotebook(self):
|
|
""" Add the main frame notebook """
|
|
logger.debug("Adding subnotebook")
|
|
notebook = ttk.Notebook(self)
|
|
notebook.pack(side=tk.TOP, anchor=tk.NW, fill=tk.BOTH, expand=True)
|
|
return notebook
|
|
|
|
def add_options_frame(self):
|
|
""" Add the display tab options """
|
|
logger.debug("Adding options frame")
|
|
optsframe = ttk.Frame(self)
|
|
optsframe.pack(side=tk.BOTTOM, padx=5, pady=5, fill=tk.X)
|
|
return optsframe
|
|
|
|
def add_options_info(self):
|
|
""" Add the info bar """
|
|
logger.debug("Adding options info")
|
|
lblinfo = ttk.Label(self.optsframe,
|
|
textvariable=self.vars["info"],
|
|
anchor=tk.W,
|
|
width=70)
|
|
lblinfo.pack(side=tk.LEFT, padx=5, pady=5, anchor=tk.W)
|
|
|
|
def set_info(self, msg):
|
|
""" Set the info message """
|
|
logger.debug("Setting info: %s", msg)
|
|
self.vars["info"].set(msg)
|
|
|
|
def add_frame_separator(self):
|
|
""" Add a separator between top and bottom frames """
|
|
logger.debug("Adding frame seperator")
|
|
sep = ttk.Frame(self, height=2, relief=tk.RIDGE)
|
|
sep.pack(fill=tk.X, pady=(5, 0), side=tk.BOTTOM)
|
|
|
|
@staticmethod
|
|
def set_mainframe_single_tab_style():
|
|
""" Configure ttk notebook style to represent a single frame """
|
|
logger.debug("Setting main frame single tab style")
|
|
nbstyle = ttk.Style()
|
|
nbstyle.configure("single.TNotebook", borderwidth=0)
|
|
nbstyle.layout("single.TNotebook.Tab", [])
|
|
|
|
def subnotebook_add_page(self, tabtitle, widget=None):
|
|
""" Add a page to the sub notebook """
|
|
logger.debug("Adding subnotebook page: %s", tabtitle)
|
|
frame = widget if widget else ttk.Frame(self.subnotebook)
|
|
frame.pack(padx=5, pady=5, fill=tk.BOTH, expand=True)
|
|
self.subnotebook.add(frame, text=tabtitle)
|
|
self.subnotebook_configure()
|
|
return frame
|
|
|
|
def subnotebook_configure(self):
|
|
""" Configure notebook to display or hide tabs """
|
|
if len(self.subnotebook.children) == 1:
|
|
logger.debug("Setting single page style")
|
|
self.subnotebook.configure(style="single.TNotebook")
|
|
else:
|
|
logger.debug("Setting multi page style")
|
|
self.subnotebook.configure(style="TNotebook")
|
|
|
|
def subnotebook_hide(self):
|
|
""" Hide the subnotebook. Used for hiding
|
|
Optional displays """
|
|
if self.subnotebook and self.subnotebook.winfo_ismapped():
|
|
logger.debug("Hiding subnotebook")
|
|
self.subnotebook.pack_forget()
|
|
self.subnotebook.destroy()
|
|
self.subnotebook = None
|
|
|
|
def subnotebook_show(self):
|
|
""" Show subnotebook. Used for displaying
|
|
Optional displays """
|
|
if not self.subnotebook:
|
|
logger.debug("Showing subnotebook")
|
|
self.subnotebook = self.add_subnotebook()
|
|
|
|
def subnotebook_get_widgets(self):
|
|
""" Return each widget that sits within each
|
|
subnotebook frame """
|
|
logger.debug("Getting subnotebook widgets")
|
|
for child in self.subnotebook.winfo_children():
|
|
for widget in child.winfo_children():
|
|
yield widget
|
|
|
|
def subnotebook_get_titles_ids(self):
|
|
""" Return tabs ids and titles """
|
|
tabs = dict()
|
|
for tab_id in range(0, self.subnotebook.index("end")):
|
|
tabs[self.subnotebook.tab(tab_id, "text")] = tab_id
|
|
logger.debug(tabs)
|
|
return tabs
|
|
|
|
def subnotebook_page_from_id(self, tab_id):
|
|
""" Return subnotebook tab widget from it's ID """
|
|
tab_name = self.subnotebook.tabs()[tab_id].split(".")[-1]
|
|
logger.debug(tab_name)
|
|
return self.subnotebook.children[tab_name]
|
|
|
|
|
|
class DisplayOptionalPage(DisplayPage):
|
|
""" Parent Context Sensitive Display Tab """
|
|
|
|
def __init__(self, parent, tabname, helptext, waittime):
|
|
DisplayPage.__init__(self, parent, tabname, helptext)
|
|
|
|
self.display_item = None
|
|
|
|
self.set_info_text()
|
|
self.add_options()
|
|
parent.select(self)
|
|
|
|
self.update_idletasks()
|
|
self.update_page(waittime)
|
|
|
|
@staticmethod
|
|
def set_vars():
|
|
""" Analysis specific vars """
|
|
enabled = tk.BooleanVar()
|
|
enabled.set(True)
|
|
|
|
ready = tk.BooleanVar()
|
|
ready.set(False)
|
|
|
|
modified = tk.DoubleVar()
|
|
modified.set(None)
|
|
|
|
tk_vars = {"enabled": enabled,
|
|
"ready": ready,
|
|
"modified": modified}
|
|
logger.debug(tk_vars)
|
|
return tk_vars
|
|
|
|
# INFO LABEL
|
|
def set_info_text(self):
|
|
""" Set waiting for display text """
|
|
if not self.vars["enabled"].get():
|
|
msg = "{} disabled".format(self.tabname.title())
|
|
elif self.vars["enabled"].get() and not self.vars["ready"].get():
|
|
msg = "Waiting for {}...".format(self.tabname)
|
|
else:
|
|
msg = "Displaying {}".format(self.tabname)
|
|
logger.debug(msg)
|
|
self.set_info(msg)
|
|
|
|
# DISPLAY OPTIONS BAR
|
|
def add_options(self):
|
|
""" Add the additional options """
|
|
self.add_option_save()
|
|
self.add_option_enable()
|
|
|
|
def add_option_save(self):
|
|
""" Add save button to save page output to file """
|
|
logger.debug("Adding save option")
|
|
btnsave = ttk.Button(self.optsframe,
|
|
image=get_images().icons["save"],
|
|
command=self.save_items)
|
|
btnsave.pack(padx=2, side=tk.RIGHT)
|
|
Tooltip(btnsave,
|
|
text="Save {}(s) to file".format(self.tabname),
|
|
wraplength=200)
|
|
|
|
def add_option_enable(self):
|
|
""" Add checkbutton to enable/disable page """
|
|
logger.debug("Adding enable option")
|
|
chkenable = ttk.Checkbutton(self.optsframe,
|
|
variable=self.vars["enabled"],
|
|
text="Enable {}".format(self.tabname),
|
|
command=self.on_chkenable_change)
|
|
chkenable.pack(side=tk.RIGHT, padx=5, anchor=tk.W)
|
|
Tooltip(chkenable,
|
|
text="Enable or disable {} display".format(self.tabname),
|
|
wraplength=200)
|
|
|
|
def save_items(self):
|
|
""" Save items. Override for display specific saving """
|
|
raise NotImplementedError()
|
|
|
|
def on_chkenable_change(self):
|
|
""" Update the display immediately on a checkbutton change """
|
|
logger.debug("Enabled checkbox changed")
|
|
if self.vars["enabled"].get():
|
|
self.subnotebook_show()
|
|
else:
|
|
self.subnotebook_hide()
|
|
self.set_info_text()
|
|
|
|
def update_page(self, waittime):
|
|
""" Update the latest preview item """
|
|
if not self.runningtask.get():
|
|
return
|
|
if self.vars["enabled"].get():
|
|
logger.trace("Updating page")
|
|
self.display_item_set()
|
|
self.load_display()
|
|
self.after(waittime, lambda t=waittime: self.update_page(t))
|
|
|
|
def display_item_set(self):
|
|
""" Override for display specific loading """
|
|
raise NotImplementedError()
|
|
|
|
def load_display(self):
|
|
""" Load the display """
|
|
if not self.display_item:
|
|
return
|
|
logger.debug("Loading display")
|
|
self.display_item_process()
|
|
self.vars["ready"].set(True)
|
|
self.set_info_text()
|
|
|
|
def display_item_process(self):
|
|
""" Override for display specific loading """
|
|
raise NotImplementedError()
|